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Preface 



In the notion of a topological vector space, there is a very nice interplay 
between the algebraic structure of a vector space and a topology on the space, 
basically so that the vector space operations are continuous mappings. There 
are also plenty of examples, involving spaces of functions on various domains, 
perhaps with additional properties, and so on. Here we shall try to give an 
introduction to these topics, without getting too much into the theory, which 
is treated more thoroughly in the books in the bibliography. Knowledge of 
linear algebra is assumed, and some familiarity with elementary topology 
would be useful, with some of the relevant material being reviewed in the 
first chapter. 
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Chapter 1 

Some background information 



1.1 Real and complex numbers 

The real numbers will be denoted R, and the complex numbers will be de- 
noted C. Thus every complex number can be written as a + bi, where a, b 
are real numebers and i'^ — —1. If 2; is a complex number with z — a + bi, 
where a, 6 G R, then a, b are called the real and imaginary parts of z. The in- 
tegers arc denoted Z, and the positive integers are denoted Z_|_. The positive 
integers together with are called the nonncgativc integers. 

Of course the real and complex numbers are equipped with the arithmetic 
operations of addition, subtraction, multiplication, and division, satisfying 
the usual properties. Let us mention also the well-known facts that every 
polynomial on R with real coefficients and having odd degree takes the value 
somewhere on R, and that every polynomial on C which is not a constant 
takes the value somewhere on C. By applying the second statement repeat- 
edly, it follows that every polynomial on C can be expressed as a constant 
times a product of linear factors. 

On the real numbers there is also the usual ordering with its standard 
properties, such as the sum and product of positive real numbers being pos- 
itive real numbers. If a, b are real numbers such that a < b, then we can 
define the open interval (a, 6), the half-open, half-closed intervals [a,b), and 
{a,b], and the closed interval [a,b], where the latter is also defined when 
a = b. Namely, the open interval (a, b) consists of the real numbers x 
such that a < X < b, the interval [a, b) consists of the real numbers x such 
that a < X < b, the interval (a, b] consists of the real numbers x such that 
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a < X <b, and [a, b] consists of the real numbers x such that a < x < b. We 
also allow a or 6 to be ±oo when appropriate, so that for example (— oo, oo) 
is the real line, and [0, oo) is the set of nonnegative real numbers. 

If is a set of real numbers, then a real number a is said to be a lower 
bound ioT E a a < X for all x & E. Similarly, a real number b is said to 
be an upper bound for E if x < b for all x ^ E. A real number c is said 
to be the greatest lower bound or infim,um of ii^ if c is a lower bound of E, 
and if a < c whenever a e R is a lower bound for E. It is easy to see from 
the definition that c is unique if it exists. A real number d is said to be the 
least upper bound or supremum of if d is an upper bound for E and b < d 
whenever 6 e R is an upper bound for E. Again, it is easy to see that d is 
unique if it exists. A completeness property of the real numbers is that every 
nonempty set E of real numbers which has an upper bound also has a least 
upper bound. This implies that every nonempty set F of real numbers which 
has a lower bound also has a greatest lower bound. Indeed, the existence 
of the infimum of F can be derived from the existence of the supremum of 
E = —F, which consists of the real numbers —x for x & F. Alternatively, the 
infimum of F can be obtained as the supremum of the set of lower bounds 
of F. 

If X is a real number, then the absolute value is denoted \x\ and defined 
by |x| = X if X > 0, \x\ — —x if x < 0. Thus the absolute value of a real 
number is always a nonnegative real number, and one can check that 

(1.1) |x + y| < |x| + = |x| |y| 
for all X, 1/ e R. 

If 2; is a complex number, z = x + yi with x,y E H, then the complex 
conjugate of z is denoted z and defined by 

(1.2) z = X — yi. 
It is easy to see that 

(1.3) z + w = z + w, 'zw = zw 

for all z,w E C, and that the complex conjugate of the complex conjugate 
of z is equal to z. Also, 

(1.4) zz = x'^ + y'^, 

and in particular zz is always a nonnegative real number. 
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The modulus or absolute value of a complex number z is defined to be 
1^1 = y/z^. It is well-known that 

(1.5) 1^ + < \z\ + \w\ 
for all 2;, w e C, and we also have that 

(1.6) \zw\ = \z\ \w\ 
for all z,w E C. 

As a special case, if ^ is a complex number such that 16*1 = 1, then 

(1.7) \Oz\^\z\ 

for all 2; e C. In effect, multiplication by 9 represents a rotation on C. 

Let {zj}'j^i be a sequence of complex numbers, and let z be another 
complex number. We say that {zj}'^^ converges to z if for every e > there 
is a positive integer N such that 

(1.8) \zj -z\ <e for all j > N. 

In this event we write 

(1.9) lim Zj — z, 

j— >oo 

and call z the limit of the sequence It is easy to see that the hmit 

of a convergent sequence is unique. 

It is easy to verify that a sequence {zj}'^-^^ of complex numbers converges 
to a complex number z if and only if the sequence of real parts of the Zj^s 
converges to the real part of z and the sequence of imaginary parts of the 
z/s converges to the imaginary part of z. Similarly, {zj}'jLi converges to z if 
and only if {zj}'jLi converges to Z of z. If {zj}'j^i is a sequence of complex 
numbers which converges to the complex number z, then {l-Zjj}^! converges 
to \z\. 

Suppose that {zj}^^^, {wj}'jLi are sequences of complex numbers which 
converge to z,w e C, respectively. It is well known that the sequences 
{zj + Wj^^i and {zjWj}'j?^i converge to z + w and zw, respectively. If 
{zj}j^i is a sequence of nonzero complex numbers which converges to the 
nonzero complex number z, then {l/zj}'jLi converges to 1/z. 

A sequence of complex numbers {zjjJLi is said to be a Cauchy sequence 
if for every e > there is a positive integer TV such that 



(1.10) 
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It is easy to check that if {zj}'^i is a convergent sequence of complex num- 
bers, then it is also a Cauchy sequence. A completeness property of the 
complex numbers states that every Cauchy sequence in C converges in C. 

Suppose that p is a positive real number. If p > 1, then the function 
on [0, oo) is convex, which means that 

(1.11) {Xa + {l-\)bf <\aP + il-\)F 

for all nonnegative real numbers a, b, and A with A < 1. This is a well-known 
fact from calculus. 

If p < 1, then another useful inequality states that 

(1.12) {a + by <aP + bP. 

This can also be analyzed in terms of calculus, and one can give a more direct 
derivation as well. 



1.2 Vector spaces 

Let V he a vector space. In this monograph we make the standing assump- 
tion that all vector spaces use either the real or the complex numbers as 
scalars, and we say "real vector spaces" and "complex vector spaces" to 
specify whether real or complex numbers are being used. To say that F is a 
vector space means that K is a nonempty set with a distinguished element 
called and operations of addition and scalar multiplication which satisfy 
the usual properties. Recall that a subset L of V" is said to be a linear sub- 
space ifO&L, v + w& L whenever v,w & L, and G L whenever C is a 
scalar, which is to say a real or complex number, as appropriate, and v G L. 
Thus L is then a vector space too, with the same choice of scalars, and using 
the restriction of the vector space operations from V to L. 

If Vi, V2 are two vector spaces, both real or both complex, then a mapping 
/ : Vi — > V2 is said to be linear if 



= f(v) + f(w) 



(1.13) f{v + w) 

for all v,w &Vi, and 

(1.14) f{av)-- 

for all scalars a and f G Vi. If / is a 
so that the inverse mapping : V2 



--af{v) 

one-to-one mapping from Vi onto V2, 
—>■ V\ is defined, then is a linear 
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mapping from V2 to Vi if / is a linear mapping from Vi to V2. In this case 
we say that / defines an isomorphism from Vi onto V2 as vector spaces, and 
that Vi, V2 are isomorphic vector spaces. 

The space of hnear mappings from Vi to V2 is denoted C{Vi,V2). It is 
easy to see that the sum of two elements of >C(Vi, ^2) defines an element of 
J^iVi, V2), and that the product of a scalar and an element of C{Vi, V2) defines 
an element of V2). Thus £(Vi, V2) is a vector space in a natural way, 
with the same scalars as for Vi, V2. For a single vector space V we may write 
C{V) instead oiC{V,V). 

If y is a real vector space and / is a linear mapping from V to R, or if 
y is a complex vector space and / is a linear mapping from V to C, then 
/ is called a linear functional on V. The space of linear functionals on V is 
called the dual of V and is denoted V. Thus V = C{V, R) and V is a real 
vector space when V is a real vector space, and V = C{V,C) and V is a 
complex vector space when y is a complex vector space. 

If Vi, V2, and Vs are vector spaces with the same scalars, and if /i : Vi — > 
V2 and /2 : V2 ^ V3 are linear mappings, then the composition f2°fi'Vi^ 
V3, defined by (/2 o fi){v) = /2(/i(f)) for v G Vi, defines a linear mapping 
from Vi to V3. For a single vector space J0.{V), we have that the composition 
of two elements of C{V) is also an element of C{V). 

If n is a positive integer, then R" and C", which consist of n-tuples of 
real and complex numbers, respectively, arc real and complex vector spaces 
with respect to coordinatcwisc addition and scalar multiplication. If V is a 
real vector space with positive finite dimension n, then V is isomorphic to 
R", and if F is a complex vector space of positive finite dimension n, then 
V is isomorphic to C". 

More generally, if n is a positive integer greater than or equal to 2, and 
Vi,V2, ■ ■ . ,Vn are vector spaces, all real or all complex, then the Cartesian 
product 

(1.15) ViXV2X---xVn 

defines a vector space in a natural way, with the same choice of scalars. 
Specifically, this Cartesian product consists of n-tuples {vi,V2, ■ ■ ■ ,Vn), with 
Vj G Vj for j = 1, 2, . . . , n. If {vi, V2, ■ ■ ■ , v^) and (wi, W2, . . . , w„) are two 
elements of the Cartesian product, then their sum is defined coordinatewise, 
which is to say that the sum is equal to 



(1.16) 



{Vi + Wi, V2 + W2,...,Vn + W„). 
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Similarly, if {vi,V2, ■ ■ ■ ,Vn) is an element of the Cartesian product and ( is 
a scalar, then the scalar product of ( with {vi,V2, ■ ■ ■ , Vn) is defined coordi- 
natewise and is equal to 

(1.17) (C^;i,C^2,...,C^n). 

Actually, the vector space that results in this manner is called the direct sum 
of Vl, V2, . . . , Ki. If each Vj has finite dimension, then the direct sum also has 
finite dimension, and the dimension of the direct sum is equal to the sum of 
the dimensions of the V/s. 

If Vi and V2 are vector spaces, both real or both complex, and if / is a 
mapping from Vi to V2, then we can associate to / its graph in the direct 
sum of Vi and V2, which is the set of ordered pairs (f , f{v)) with v G Vi. One 
can verify that / is a linear mapping from Vi to V2 if and only if the graph 
of / is a linear subspace of the direct sum of Vi and V2. 

Let n be a positive integer, n > 2, and suppose that Vi, V2, . . . , 14 and 
Wi,W2t . . 1 Wn are vector spaces, all with the same choice of scalars. Also 
assume that for each j' = 1, 2, . . . , n we have a linear mapping fj : Vj Wj. 
Then we get a linear mapping F from the direct sum of the Vj 's to the direct 
sum of the Wj^s in a natural way, following the rule 

(1-18) (^^1, 1^2, ...,Vn)^ (f(vi), f(v2), f(Vn)). 

A complex vector space can be viewed as a real vector space by "restric- 
tion of scalars" , which amounts to just using real numbers as scalars even if 
complex multiplication by i is also defined. If F is a complex vector space 
of finite dimension n, then when we view it as a real vector space in this 
manner, it has dimension 2n. If V is a real vector space, then we can "com- 
plexify" it by taking the Cartesian product V x V, initially as a real vector 
space, and then extending the scalar multiplication to complex numbers by 
taking 

(1.19) i {vi,V2) = {-V2,Vi). 

In other words, if V denotes the complexification of V, then we can think of 
V as consisting of vectors of the form Vi + V2 i, where Vi,V2 G V, and where 
scalar multiplication by i is defined in the obvious manner. If is a real 
vector space with finite dimension n, then the complexification V" of y is a 
complex vector space with dimension n. 

Here is another point of view with similar ideas. Let be a real vector 
space, and let J be a linear mapping from W to itself whose square as a 
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linear mapping is equal to minus the identity mapping on W, i.e., 

(1.20) J{J{w)) = -w 

for all w G W. Then we can view W as a complex vector space, where iw 
is defined to be J{w) for all w e W. If W has finite dimension n as a real 
vector space, then n is necessarily even in this case, and W has dimension 
n/2 as a complex vector space. 

Let V he a, vector space, real or complex, and let be a subset of V. We 
say that E is convex if A f + (1 — X)w G E whenever v,w & E and A G [0, 1]. 
If A and B are nonempty subsets of V, then we write ^4 + i? for the subset 
of V consisting of vectors of the form v + w, where v E A and w E B. li A 
is a nonempty subset of V and C is a scalar, i.e., a real or complex number, 
as appropriate, then we write ( A for the subset of V consisting of vectors of 
the form ( v, where v E A. The statement that E is convex can be rewritten 
as saying that 

(1.21) XE+{1- X)E CE 
for aU A G [0, 1]. 

If A and B are nonempty subsets of V which are convex, then A + B is 
convex too. li A is a convex nonempty subset of V and C is a scalar, then 
( Ais a convex subset of V. 

If is a nonempty convex subset of V and f{v) is a real- valued function 
on E, then we say that f{v) is convex if 

(1.22) f{Xv + (1 -X)w)< Xf{v) + (1 - A) f{w) 

for all V, w G E and A G [0, 1]. The sum of two convex functions is convex, 
and the product of a convex function by a nonnegative real number is convex. 

The property of convexity of f{v) on E can be characterized geometrically 
as follows. Inside the Cartesian product \^ x R, consider the set 

(1.23) {(v, t) eV xR:v e E, t> f(v)}. 

The function f{v) on E is convex if and only if this is a convex subset of 
VxR. 

If ^4 is a nonempty subset of V, then we say that A is symmetric if 
—A = A. A subset A oi V which contains is said to be starlike around 
if t A C A for each real number t such that 0<t<l. If V is a complex 
vector space and ^4 is a nonempty subset of V, then A is said to be circular 
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if 6 A = A ioY all complex numbers 6 such that \6\ = 1. Thus a nonempty 
subset A of V is starlike about and circular if and only if ^ ^4 C ^4 for all 
complex numbers ( such that \(\ < 1. 

If y is a vector space and A is a nonempty subset of V, then the convex 
hull of A is denoted co{A) and is the subset of V consisting of all convex 
combinations of elements of A. More precisely, a vector w &V lies in co{A) 
if there is a positive integer n, vectors vi,...,Vn & A, and real numbers 
Ai, . . . , An e [0, 1] such that 

n n 

(1.24) w = J2^i^i and ^A, = 1. 

1=1 1=1 

It is easy to see from the definitions that co{A) = A when A is a convex 
subset of V, and that co{A) is always a convex subset of V. Also, if F is a 
real vector space of finite dimension m, then the convex hull of a nonempty 
subset A of K is equal to the set of points in V which can be expressed as 
convex combinations of at most m + 1 elements of A. 



1.3 Topological spaces 

Let X be a nonempty set. If A is another nonempty set, then {Ea}aeA 
defines a family of subsets of X if E^ is a subset of X for each a E A. The 
set A is called the index set of the family. The union and intersection of the 
sets in the family are denoted 

(1.25) U E^, fl E^, 

and the union consists of the points in X which lie in E^, for at least one 
a G A, while the intersection consists of the points in X which lie in E^ for 
every a & A. 

If F is a subset of X, then the complement of F in X is denoted X\F 
and it is defined to be the set of points in X which do not lie in F . Of course 
the complement of the complement of F in X is F itself. If {Ea}a&A is a 
family of subsets of X as above, then 



(1.26) 
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and 

(1.27) x\( n E^ = uinEa). 

Let X be a nonempty set, and let r be a collection of subsets of X. We 
say that r defines a topology on X if the empty set and X itself lie in r, if 
the union of any family of elements of r is again an element of r, and if the 
intersection of any finite collection of elements of r is also an element of r. 
The combination of X and r is called a topological space. 

For any set X, we might choose r so that it contains only and X, i.e., 
this satisfies the conditions just mentioned. This is the smallest possible 
topology on X. At the other extreme we might take r to be the collection 
of all subsets of X, which is the largest possible topology on X, also known 
as the discrete topology on X. We shall normally be interested in topologies 
between these, although the discrete topology is sometimes useful. 

When a nonempty set X is equipped with a topology r in this way, the 
elements of r are called the open subsets of X. A subset F of X such that 
X\F is open is said to be a closed subset of X. By the conditions mentioned 
before, the empty set and X itself are automatically closed subsets of X, 
the intersection of any family of closed subsets of X is again a closed subset 
of X, and the union of finitely many closed subsets of X is a closed subset 
of X. 

If (X, r) is a topological space, is a subset of X, and p is a point in X, 
then p is said to be a limit point of E if for each open subset U oi X such 
that p & U there is a point q & E such that q eU and E. One can check 
that a subset F of X is closed if and only every limit point of F in X is also 
an element of F . 

If F is a subset of the topological space X, then the closure of F is 
denoted F and defined to be the union of F and the set of fimit points of 
F. Thus p e F if and only if for every open subset U ol X such that p e U 
there is a point q E E which satisfies q E U. 

A subset D of X is said to be dense if the closure of D is equal to X. This 
is the same as saying that D is dense in X if every nonempty open subset of 
X contains an element of D. 

The interior of a subset ^4 of X is denoted A° and is defined to be the 
set of points x E A such that there is an open subset U of X which satisfies 
X eU and U A. Because the union of any family of open subsets of X is 
an open subset of X, the interior of A is always an open subset of X, which 
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may be the empty set. If £■ is a subset of X, then one can check that 

(1.28) X\E={X\E)°, 

which is to say that the complement of the closure of in X is equal to the 
interior of the complement oi E in X. As a result, the closure of E is always 
a closed subset of X. 

It is often natural to assume separation conditions on a topological space. 
One of the simplest of these asks that each subset of the topological space 
with exactly one element is a closed subset of the topological space. This 
implies automatically that every finite subset of the topological space is a 
closed subset. If X is a topological space which has this property, if is a 
subset of X, and if p is a limit point oi E in X, then for every open subset 
U oi X such that p ^ U, the set E nU has infinitely many elements. 

A topological space (X, r) is said to be Hausdorff if for every pair of 
distinct points p,q & X there are open subsets U, W oi X such that p E U, 
q ^ W, and U HW — This condition implies the one described in the 
previous paragraph. 

If X is a nonempty set and d{x, y) is a real-valued function on the Carte- 
sian product X X X oi X with itself, then d{x, y) is said to be a semimetric 
if d{x, y) > for all x,y ^ X, d{x, x) = for all x & X, 

(1.29) d{x,y)^d{y,x) 
for all x,y & X , and 

(1.30) d{x,z) <d{x,y) + d{y,z) 

for all x,y,z & X. If also d{x, y) > when x ^ y, then d{-, ■) is said to be a 
metric. 

If d{x,y) is a semimetric on X, then we can define a topology on X by 
saying that a subset U of X is open if and only if for every x G f/ there is a 
positive real number such that y E U ioi all y E X which satisfy d{x, y) < r. 
This topological space has the property that subsets of X with exactly one 
element are closed subsets of X if and only if d(-,-) is a metric. Conversely, 
if d{-, ■) is a metric, then the associated topology on X is Hausdorff. 

A basic observation about semimetrics is that if d{x, y) is a semimetric 
on X, then for each p E X and each positive real number t the open ball 
centered at p with radius t with respect to the semimetric, defined by 



(1.31) 



{z E X : d{z,p) < t}, 
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is an open subset of X with respect to the topology that comes from d{x, y). 
This is not hard to show, using the triangle inequality. 

As basic examples, the real line R has the standard metric |a; — and on 
the complex numbers C we have the standard metric jz — w|. The topologies 
on R and C associated to these metrics are called their standard topologies. 

If ^ is a nonempty family of semimetrics on X, then we can define a 
topology on X by saying that a subset U of X is open if and only if for 
each point x E U there are semimetrics di{- ,■),..., dn(- , ■) in the family JF 
and positive real numbers ri, . . . ,r„ such that y E U when y E X satisfies 
dj{y, x) < for j = 1, . . . , n. With this topology, one-element subsets of X 
are closed if and only if for every pair of distinct points p,q E X there is a 
semimetric d{-, ■) in the family such that d{p,q) > 0, and conversely this 
condition implies that X is Hausdorff. 

Notice that if d{x,y) is a semimetric on X, and a, b are positive real 
numbers such that b < 1, then 



are semimetrics on X as well. In terms of defining topologies, as above, these 
semimetrics are all equivalent to the original semimetric d{x, y) . 

If (X, r) is a topological space and F is a nonempty subset of X, then 
we get a natural topology ry on Y induced from the one on X by taking 
Ty to be the collection of subsets of Y of the form F fl ^7, where U E r. In 
other words, a subset of Y is considered to be open relative to Y if it is the 
intersection of Y with an open subset of X. With respect to this topology 
on y, a subset of Y is closed relative to Y if it is the intersection of Y with 
a closed subset of X . If X has the property that one-element subsets are 
closed, then so does F, and if X is Hausdorff, then so is Y too. 

Now suppose that n is a positive integer greater than or equal to 2, 
and that (Xi, ti), (X2, T2), . . . , (X„, r^) are topological spaces. Consider the 
Cartesian product 



which consists of n-tuples of the form (xi, X2, . . . , x„) with Xj E Xj for j — 
l,2,...,n. There is a natural topology on the Cartesian product of the 
Xj's, in which a subset W of the Cartesian product is open if for each point 
{xi, X2i ■ ■ ■ 1 Xn) in W there are open subsets Uj of X^, 1 < j < n, such that 



(1.32) 



min((i(a;,|/), 1), d{x,yf, 



d{x,y) 



1 + d{x,y) 



(1.33) 



Xi X X2 X • • • X X, 
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Xj e Uj for each j and 

(1.34) UiXU2X---XUn^W. 

In other words, a subset 1^ of Xi x X2 x ■ ■ ■ x X„ is considered an open subset 
if it can be expressed as the union of Cartesian products of open subsets of 
the X/s. This topology on the Cartesian product of the X/s is caUed the 
product topology associated to the topologies on the X/s individually. 

In particular. Cartesian products of open subsets of the Xj^s define open 
subsets of the Cartesian product of the X/s. One can also check that Carte- 
sian products of closed subsets of the X/s define closed subsets of the Carte- 
sian product. As a result, if each Xj has the property that one-element 
subsets are closed subsets, then the same holds for the Cartesian product 
of the X/s. Similarly, if each Xj is Hausdorff, then one can verify that the 
Cartesian product of the Xj^s is Hausdorff. 

Let X and Y be sets, and suppose that / is a mapping from X to Y. If 
A is a. subset of X, then the image of A under / in F is denoted f{A) and 
defined by 

(1.35) f{A) = {y e y : y = f{x) for some x e A}. 
If {A^y^^i is a family of subsets of X, then 



(1-36) / =U/(A)- 

For intersections we have the inclusion 

(1-37) /(n^) ^n/(A), 

\e7 ^ (,6/ 

and equality does not have to hold in general. 

If £^ is a subset of Y, then the inverse image of E under / in X is denoted 
f-\E) and defined by 

(1.38) r\E) = {xeX: fix) e E}. 

The inverse image behaves nicely in the sense that for each family {E^yp^B 
of subsets of Y we have that 

(1-39) r'([JEp)= ur'W 
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and 

(1-40) r'(nE,) = n/"'(^/3), 

and also 

(1.41) r\Y\E) = X\f-\E) 

for each subset E oiY. 

Let (X, a) and (Y, r) be topological spaces, and let / be a mapping from 
X to Y. If p is a point in X, then wc say that / is continuous at p if for 
every open subset W of Y such that f{p) G W there is an open subset U 
of X such that U C f~^(W). We say that f : X Y is continuous if / is 
continuous at every point p in X. This is equivalent to saying that f^^{W) 
is an open subset of X for every open subset W of Y, or that f~^{E) is a 
closed subset of X for every closed subset E of Y. 

If f : X ^ Y is continuous, then notice that 

(1-42) f(A) C JiA) 

for every subset A of X. In other words, the image of the closure of A in 
X under /, which is a subset of Y, is contained in the closure of the image 
of A under / in Y. Another nice property of continuous mappings is that if 
f : X ^Y is continuous, then the graph of f in X x Y, defined by 

(1.43) {{x,y)eXxY:y^f{x)}, 

is a closed subset of X xY with respect to the topology on X xY obtained 
from the topologies on X, Y as above. The space of continuous mappings 
from X to y will be denoted C(X, Y). 

Suppose that n is a positive integer, n > 2, and that {Xj,aj), (Yj,Tj), 
1 < J < "^j arc topological spaces. Assume also that for each j = 1,2, ... ,n 
we have a mapping fj : Xj — > Yj. We can combine these mappings in a 
natural way to get a mapping F from the Cartesian product of the Xj^s into 
the Cartesian product of the Y/s, defined by 

(1.44) {Xi,X2, ...,Xn)^ {fl{Xl)j2{x2), ■ ■ .Jn{Xn))- 

If for each j we have a point pj in Xj and fj is continuous at pj, then F 
is continuous as a mapping between the Cartesian products at the point 
{pi,P2, . . . ,Pn)- If fj '■ Xj — > Yj is continuous for each j, then 

(1.45) F : X ^2 X • • • X A:„ ^ Fi X 1^2 X • • • X F„ 
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is also continuous. 

Let (Xi, Ti), {X2, T2), and (X3, r^) be topological spaces. Assume that /i 
is a mapping from Xi to X2, and that /2 is a mapping from X2 to X3. If p is 
an element of Xi, fi is continuous at p, and /2 is continuous at then 
it is easy to check that the composition /2 o /i, which is a mapping from Xi 
to X3, is continuous at p. If /i is continuous as a mapping from Xi to 
and /2 is continuous as a mapping from X2 to X^, then /2 o /i is continuous 
as a mapping from Xi to X3. 

If (X, cr) and (F, r) are topological spaces and / is a one-to-one mapping 
from X onto Y, so that the inverse mapping from y to X exists, then / 
is said to be a homeomorphism from X onto Y if /, are both continuous 
as mappings from X to F and from Y to X, respectively. In this case is 
also a heomeomorphism from Y onto X. 

If {X, r) is a topological space, and if /i, /2 are two real- valued continuous 
functions on X, or two complex- valued continuous functions on X, then the 
sum /i -|- /2 and the product /i /2 are also continuous functions on X. One 
way to look at this is as a consequence of the fact that the mappings from 
R X R to R and from C x C to C given by addition and multiplication are 
continuous. 

1.4 Countability conditions 

Let £■ be a set. To be a bit formal, we say that E is finite if it is empty, 
in which case it has elements, or if there is a positive integer n such that 
there is a one-to-one correspondence between E and the set {1, 2, . . . , n} of 
the first n positive integers, in which case we say that E has n elements. If 
there is a one-to-one correspondence between E and the set Z_|_ of positive 
integers, then we say that E is countably-infinite, and we say that E is 
at most countable if E is either finite or countable. Of course the union of 
finitely many finite sets is a finite set, and if {E'^ja G A is a family of subsets 
of a set X such that the index set A is at most countable and each E^., a ^ A, 
is at most countable, then the union UaeA is also at most countable. 

Now let (X, cr) be a topological space, and let B be a collection of open 
subsets of X. We say that B is a basis for the topology of X if every open 
subset of X is the union of some collection of open sets in B. If p is a point 
in X, then we say that i3 is a local basis for the topology of X at p if for every 
open subset t/i of X such that p e t/i there is an open subset U2 of X such 
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that p e U2, U2 ^ Ui, and U2 G B. It is easy to see that i3 is a basis for the 
topology of X if and only if ;B is a local basis for the topology of X at each 
point in X. 

If p is a point in X, then we say that X satisfies the first axiom of 
countability at p if there is a local basis for the topology of X at p which has 

at most countably many element. We say that X satisfies the first axiom of 
countability if X satisfies the first axiom of countability at each point in itself. 
We say that X satisfies the second axiom of countability if there is a basis 
for the topology of X which has at most countably many elements. Notice 
that the second axiom of countability implies the first axiom of countability. 

Suppose that {pj}'^i is a sequence of points in X, and that p is a point 
in X. We say that {pj}°^i converges to p if for every open subset U of X 
such that p E U, there is a positive integer N so that pj £ U when j > N. 
In this case we write 

(1.46) lim Pj — p. 

If X has the property that one-element subsets of X are closed subsets of X, 
then a sequence of points in X can have at most one limit, i.e., the limit is 
unique when it exists. 

Let p be an element of X, let £■ be a subset of X, and assume that X 
satisfies the first axiom of countability at p. The p is an element of the closure 
of E if and only if there is a sequence {pj}'^^ of points in E which converges 
to p. If p e E, we can simply take Pj = p for all j here. 

Suppose that {X,a) and {Y,t) are topological spaces, p is a point in X, 
and / is a mapping from X toY. If X satisfies the first axiom of countability 
at p, then / is continuous at p if and only if for every sequence {pj}^i of 
points in X which converges to p, we have that {f{Pj)}'jLi converges to /(p) 
in Y. 

Let {X, a) be a topological space, and let ;B be a collection of open subsets 
of X. Define B to be the collection of subsets of X which are intersections 
of finitely many subsets of X in B. Thus B is at most countable if B is at 

most countable. 

The collection B of open subsets of X is said to be a sub-basis for the 
topology of X if is is a basis for the topology of X. Similarly, if p is a point 
in X, then B is said to be a local sub-basis for the topology of X at p if B is a. 
local basis for the topology of X at p. It is easy to see that i3 is a sub-basis 
for the topology of X if and only if B is a local sub-basis for the topology of 
X at each point in X. 
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One can go in the other direction and start with a nonempty set X and 
a collection B of subsets of X, define B as before, and then define a topology 
on X so that i3 is a sub-basis for that topology, namely, where a subset of X 
is open if it is a union subsets of X in B. For this to work one should assume 
that the union of the subsets of X in B is all of X, and one can interpret 
the empty subset of X as the empty union of subsets of X in B, although 
it is also easy for the empty set to occur as an intersection of finitely many 
subsets of X in B. 

A basic situation of this type arises with famihes of semimetrics, as dis- 
cussed in the previous section. Specifically, if ^ is a nonempty family of 
semimetrics on X, then the topology on X associated to this topology is 
the same as the topology for which the collection B of open balls in X with 
respect to the semimetrics in ^ is a sub-basis. 

If T is at most countable, then it is easy to see that the corresponding 
topology on X satisfies the first axiom of countabihty. In fact, if is at 
most countable, then there are simple tricks for defining a single semimetric 
on X with the same topological information as the family of semimetrics. 
However, it may be that the semimetrics in have some nice features and 
that one would like to keep them. 

Notice that if {Xi, ti), . . . , {Xn, Tn) are topological spaces, pi, . . . ,pn are 
points in Xi, . . . respectively, and Xj satisfies the first axiom of count- 
ability at pj for j = 1, ... , n, then the product Xi x ■ ■ ■ x X„, with the product 
topology discussed in the previous section, satisfies the first axiom of count- 
ability at the point {pi, ■ ■ ■ ,Pn)- Hence if Xi, . . . , X„ satisfy the first axiom 
of countabihty at all of their points, then so does the product Xi x • • • x X„. 
Similarly, if Xi, . . . ,X„ satisfy the second axiom of countabihty, then the 
product Xi X ■ ■ ■ X Xn does too. 

A topological space (X, r) is said to be separable if it has a subset which 
is at most countable and also dense. If X satisfies the second axiom of 
countabihty, then X is separable. Conversely, if the topology on X comes 
from an at most countable family of semimetrics, and if X is separable, then 
X satisfies the second axiom of countabihty. 

Notice that the notions of basis and sub-basis and the countabihty con- 
ditions for a topological space behave well in terms of restricting from that 
space to a subspace. To be more precise, let (X, r) be a topological space, 
let y be a nonempty subset of X, and let ry be the topology on Y induced 
from the one on X by saying that a subset of F is open relative to Y if it 
is of the form U HY, where U is an open subset of X. Suppose that i3 is a 
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collection of open subsets of X, and put 

(1.47) By = {UnY -.U eB}. 

If p is a point in Y and i3 is a local basis for the topology of X at p, then By 
is a local basis for the topology of Y at p. Similarly, if i3 is a local sub-basis 
for the topology of X at p, then By is a local sub-basis for the topology of Y 
at p. If B is a basis for the topology of X, then By is a basis for the topology 
of Y, and if is a sub-basis for the topology of X, then By is a sub-basis 
for the topology of Y. As a result, if p & Y and X satisfies the first axiom 
of countability at p, then Y also satisfies the first axiom of countability at p. 
If X satisfies the first axiom of countability, then Y satisfies the first axiom 
of countability, and if X satisfies the second axiom of countability, then Y 
satisfies the second axiom of countability. 

1.5 Compactness 

Let {X, t) be a topological space, and let E he a subset of X. By an open 
covering of in X we mean a family {Ua}aeA of open subsets of X such 
that E C UaeA Ua- We say that E is compact if for every open covering of 
in X there is a finite subcovering of E from that open covering. In other 
words, if {Ua}aeA is an open covering of E in X, then we ask that there be 
a finite subset Ai of A such that E C IJaeAi Ua- 

If {X, a), {Y, t) are topological space, / is a continuous mapping from X 
to y, and £■ is a compact subset of X, then f{E) is a compact subset of Y. 

There are a number of related notions and variants of compactness that 
one sometimes likes to consider. Let us say that a subset of X is countahly 
compact if for every open covering {Ua}aeA of in X there is a subcovering 
of E from this covering which is at most countable, which is to say that there 
is a subset A2 of A which is at most countable such that E C IJ^^^^ 

A basic fact is that if (X, r) is a topological space, y is a nonempty subset 
of X, and is a subset of F, then E is compact as a subset of X if and only 
if E is compact as a subset of Y , using the topology on Y induced from the 
one on X. In the same way, if E is countably compact as a subset of X, then 
E is countably compact as a subset of Y. 

It is well-known and not hard to show that if X satisfies the second axiom 
of countability, then every subset of X is countably compact. Thus if (X, r) 
is a topological space which satisfies the second axiom of countability and if 
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E is a subset of X, then E is compact if and only if for every open covering 
{f^ojaeA of E with index set A which is at most countable, there is a finite 
subcovcring of E from this open covering. 

If {X, t) is a topological space and is a subset of X, then E has the 
limit point property if every infinite subset L \i E has a limit point in X 
which is also an clement of E. If is a compact subset of X, then E satisfies 
the limit point property. To see this, assume for the sake of a contradiction 
that E does not satisfy the limit point property. This means that there is an 
infinite subset L of E such that no element of is a limit point of L. This 
implies in turn that for each p & E there is an open subset Up of X such 
that p & Up and Up (1 L is either empty or contains p only. Thus {Up}p G E 
is an open covering of in X, and the compactness of E implies that there 
is a finite subset Ei of E such that E C UpeEi Up. Because L C. E and 
LdUp has at most one element for each p e -E", it follows that L is finite, a 
contradiction. Thus compactness implies the limit point property. 

As for compactness, if (X, r) is a topological space, F is a nonempty 
subset of X, and E is a subset of Y, then E has the limit point property as 
a subset of X if and only if E has the limit point property as a subset of Y, 
equipped with the topology induced from the one on X. This is because a 
point in £^ is a limit point of a subset L of £■ in the topological space X if 
and only if this holds in the topological space Y. 

Let (X, r) be a topological space and let Ei, E2 be subsets of X. If Ei, 
E2 are compact, then so is EiU E2. If Ei, E2 have the limit point property, 
then El U E2 has the limit point property too. If E, F are subsets of X such 
that F C E, F is closed, and E is compact, then F is compact. If F 
are subsets of X such that F O E, F is closed, and E has the limit point 
property, then F has the limit property. It is immediate from the definitions 
that finite sets are compact and have the limit point property. 

Here is a reformulation of compactness which is sometimes useful. A topo- 
logical space (X, r) is itself compact if and only if for every family {Fa}aeA 
of closed subsets of X such that ClaeAo ^ whenever Aq is a nonempty 

finite subset of A, we have that ClaeA 7^ 0- If (AT, r) satisfies the second 
axiom of countability, then we can restrict our attention to families of closed 
subsets of X which are at most countable, and which can then be arranged 
in a sequence. In fact we get that if (X, r) satisfies the second axiom of 
countability, then X is compact if and only if for every sequence {Fj}jli of 
nonempty closed subsets of X such that F^+i C Fj for all j we have that 

nr=i ^ 0. 
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Suppose that (X, r) is a Hausdorff topological space. Let us check that 
if is a compact subset of X, then E is closed. Assume for the sake of a 
contradiction that p is a limit point of E which is not an element of E. For 
each point q ^ E, let U{q), V{q) be disjoint open subsets of X such that 
q e U{q) and p e V{q). Thus {U{q)}q^E is an open covering of E, and 
therefore there is a finite subset Ei of E such that 

(1.48) EC [j U{q). 

qeEi 

This implies that E is disjoint from Hq^Ei ^(?)) which is an open subset of 
X that contains p. This contradicts the assumption that p is a limit point 
of E, and it follows that E is a closed subset of X. 

A subset of a topological space X is said to be sequentially compact 
if for every sequence {xj}'^-^ of points in E there is a subsequence {xj^}'^l 
and a point x E E such that {xj^}ili converges to x. It is easy to see that 
finite sets are sequentially compact, and that if E is sequentially compact, 
then E has the limit point property. The union of two sequentially compact 
subsets of X is also sequentially compact, and a closed subset of a sequentially 
compact subset of X is sequentially compact. If {X, r) is a topological space, 
y is a nonempty subset of X, and £■ is a subset of Y, then E is sequentially 
compact as a subset of X if and only if E is sequentially compact as a subset 
of Y, equipped with the topology induced from the one on X. 

Suppose that {X, r) is a topological space which satisfies the first axiom of 
countability and in which one-element subsets are closed. Let E he a subset 
of X which satisfies the limit point property, which holds in particular when 
E is compact, and let us show that E is sequentially compact. Let {a;j}°2=i 
be a sequence of points in E, and let L denote the subset of X consisting of 
the points in this sequence. If L is a finite set, then there is a subsequence 
of {xjjJLi in which all of the terms are the same, and this subsequence 
converges trivially. Thus we assume that L is infinite. Because E satisfies 
the limit point property, there is a point x E E which is a limit point of L. 
It is not difficult to show that there is then a subsequence of {xj}'j^i which 
converges to x. 

If {X, t) is a topological space which satisfies the first axiom of countabil- 
ity and in which one-element subsets are closed, and if £^ is a sequentially- 
compact subset of X, then is a closed subset of X. 

If (X, r) is a topological space which satisfies the second axiom of count- 
ability and if X is sequentially compact, then X is compact. Indeed, as men- 
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tioncd above, it suffices to show that if {Fj}^^^ is a sequence of nonempty 
subsets of X such that -Fj+i C Fj for all j, then Cl^Li Fj 7^ 0. For each pos- 
itive integer j, let xj be an element of Fj. This gives a sequence {xj}JLi of 
points in X, and sequential compactness implies that there is a subsequence 
of this sequence which converges to a point x E X. It is easy to see that 
X G Fj for all j, as desired. 

Suppose that {Xi,Ti), {X2,T2) arc topological spaces, and consider the 
Cartesian product Xi x X2 equipped with the product topology coming from 
the topologies on Xi, X2. If Ei, E2 are compact subsets of Xi, X2, respec- 
tively, then El x £^2 is a compact subset of X1XX2. If -Bi, E2 are sequentially 
compact subsets of Xi. X2, then Ei x E2 is a sequentially compact subset of 
Xi X X2. These statements are not too difficult to show. 

A fundamental result states that closed and bounded subsets of R" are 
compact. 



Chapter 2 

Topological vector spaces 



2.1 Basic notions 

To say that V isa. topological vector space means that y is a vector space, that 
V is also equipped with a topology, and that with respect to this topology 
the vector space operations 

(2.1) addition : V x V ^ V, 

and 

(2.2) scalar multiphcation : R x F — > y 
if V is a real vector space or 

(2.3) scalar multiplication : C xV 

if y is a complex vector space, are continuous. 

It is easy to see from the definition that if F is a topological vector space 
and Vq is an element of V, then the translation mapping 

(2.4) V ^ V + vo 

defines a homeomorphism from V onto itself. Similarly, if a is a nonzero 
scalar, then the dilation mapping 

(2.5) V ^ av 
defines a homeomorphism from V onto itself. 
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The continuity of the binary operation of vector addition at (0, 0) inV xV 
is equivalent to the statement that for each open subset Ui of V such that 
e t/i, there is an open subset U2ofV such that e t/2 and 

(2.6) U2 + U2C Ui. 

This condition is often useful as a way of saying that U2 is about "half" the 
size of Ui, or smaller. If Ui is convex, then one can simply take 

(2.7) U2^lu„ 

but this does not work in general. 

If £■ is a nonempty subset of V and U is an open subset of V such that 
G f/, then consider the set 

(2.8) E + U. 

This is an open subset of V which contains E. In fact, one can check that 
the closure of E is contained in E -\-U. If Bq is a local basis for the topology 
of V at 0, then one can also check that 

(2.9) E^ n (^+^)- 

ueBo 

If Ui is an open subset of V such that E Ui, then there is an open subset 
U2 of V such that E U2 and the closure of U2 is contained in Ui. Indeed, 
by the remarks of the preceding paragraph, it is enough to choose U2 so that 
U2 + U2 Q Ui, as before. 

The continuity of scalar multiphcation at (0, 0) is equivalent to the state- 
ment that for each open subset W of V such that E W there is a positive 
real number r and an open subset U of V such that G f/ and av E W 
whenever a is a scalar which satisfies |q;| < r and v E U. If we put 

(2.10) U= [j aU, 

\a\<r 

where the union is taken over scalars a, then U is an open subset of V and 

(2.11) U CW. 

Moreover, U is starlike around 0, symmetric when y is a real vector space, 
and circular when V is a complex vector space. 
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Let U be an open subset of V such that G U, and let v be a nonzero 
vector in V. Using the continuity of scalar multiplication, it follows that 
there is a positive real number r so that av E U when o; is a scalar which 
satisfies \a\ < r. As a result, 

oo 

(2.12) [jnU^V. 

n=l 

Lemma 2.13 If V is a topological vector space and {0} is a closed subset of 
V , then V is Hausdorff as a topological space. 

Prom now on in this monograph we make the standing assumption that 
{0} is a closed subset in a topological vector space, so that topological vector 
spaces are Hausdorff, unless otherwise stated in some situation 

If y is a topological vector space and {0} is a closed subset of V, then 
every one-element subset of V is closed, because translations on V are home- 
omorphisms. To show that V is Hausdorff, let p, be a pair of distinct 
elements of V . We would like to show that there are disjoint open subsets 
of V that contain p, q. We may as well assume that p = 0, so that q is any 
element of V which is different from 0, by using translations again. 

Let W be the open subset of V defined by 1^ = Because F is a 

topological vector space, there is an open subset U olV such that e C/ and 

(2.14) U -U QW. 

It follows that U and U + q are disjoint open subsets of V containing 0, q, 
respectively, as desired. This proves the lemma. 

Suppose that V is a topological vector space and that L is a linear sub- 
space of V. Then L also inherits a topology from the one on V. It is easy to 
see that L is a topological vector space in its own right, with respect to this 
topology. 

Now suppose that Vi, . . . ,Vn are topological vector spaces, all real or all 
complex. Consider the direct sum of the V^'s, which is defined as a vector 
space by taking the Cartesian product 

(2.15) 1^1 X 1/2 X ••• X 14 

and using coordinatewise addition and scalar multiplication. The topologies 

on the V^'s lead to the product topology on the direct sum, and one can 
check that the direct sum becomes a topological vector space in this way. 
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If y is a real topological vector space, then one can complexify it first 
as a vector space by taking the direct sum of V with itself, and defining 
multiplication by i on the direct sum by i{vi,V2) = {—V2,vi). The topology 
on V again leads to the product topology on the direct sum, and one can 
verify that the complexification of V becomes a complex topological vector 
space. 

Let X be a topological space and V a topological vector space, and recall 
that C{X, V) denotes the space of continuous mappings from X to V. One 
can check that sums and scalar multiples of continuous mappings from X to 
V are again continuous mappings. In other words, C{X, V) is a vector space 
in a natural way, which is real if V is real and complex if V is complex. 



2.2 Norms, seminorms, and local convexity 

Let V he a vector space. A real-valued function N{v) on V is said to be a 
seminorm if N{v) > for all v & V, if the homogeneity condition 

(2.16) N{av) ^\a\N{v) 

holds for all scalars a, which is to say for all real or complex numbers a, as 
appropriate, and for all v &V, and if the triangle inequality 

(2.17) N{v + w)<N{v) + N{w) 

holds for all v,w eV. If also N{v) > when v 0, then we say that N{v) 
defines a norm on V. 



Remark 2.18 If N{v) is a nonnegative real-valued function on V which 
satisfies the homogeneity condition above, then N{v) satisfies the triangle 
inequality, and hence is a seminorm, if and only if N{v) is a convex function 
on V. This is also equivalent to the associated open unit ball 

(2.19) {veV: N{v) < 1} 

being a convex subset of V. These statements are not difficult to verify. 
If N(v) is a seminorm on V, then 



(2.20) 



\N{v)-N{w)\ < N{v-w) 



2.2. NORMS, SEMINORMS, AND LOCAL CONVEXITY 



25 



for all v,w G V, as one can check using the triangle inequality. If y is a 
topological vector space, then it follows that N{v) is continuous as a real- 
valued function on V if and only if the open unit ball with respect to N{v) 
is an open subset of V. 

If N(v) is a seminorm on V, then 

(2.21) d{v,w) = N{v-w) 

defines a semimetric on V. If N{v) is a norm, then d{v, w) as just defined is 
a metric on V . 

A vector space V equipped with a choice of norm N{v) is called a normed 
vector space. The norm leads to a metric and hence a topology on V , and it 
is easy to sec that V becomes a topological vector space in this manner. It 
is not too difficult to check that two norms Ni{v), N2{v) on a vector space 
V determine the same topology on V if and only if there is a positive real 
number such that A^i(v) < C N2{v) and N2{v) < C Ni{v) for all v eV. 

Suppose that ^ is a nonempty family of seminorms on V. This leads to a 
family of semimetrics on V as above. Let us assume that for each v & V such 
that V ^ there is a seminorm N E T such that N{v) ^ 0. Then the family 
of semimetrics on V associated to the seminorms in J-' defines a Hausdorff 
topology on V, and V becomes a topological vector space in this way. 

A topological vector space V is said to be locally convex if for each open 
subset W of V such that & W there is an open subset U of V such that 
G f/, f/ C \/, and U is convex. This is equivalent to saying that there is 
a local basis for the topology of at consisting of convex open subsets of 
V, and it is also equivalent to saying that there is a basis for the topology 
of V consisting of convex open subsets of V. If F is a topological vector 
space where the topology can be defined by a family of seminorms, then V 
is locally convex. 

Let V" be a vector space, and let E he a subset of V. Assume that & E, 
that E is starhke around 0, and that E is symmetric when F is a real vector 
space and E is circular when y is a complex vector space. Assume also that 

oo 

(2.22) \JnE^V. 

n=l 

Under these conditions, the Minkowski function associated to E is the func- 
tion fiE{v) defined on V by 

(2.23) fiE{v) = mf{t >0:t-^v e E}. 
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Thus ij.e{v) is a nonnegative real-valued function on V such that fiE{0) = 0, 
n{av) = \a\ //^(f ), < 1 for all v & E, and v & E when < 1. If £^ 
is convex, then He{v) defines a seminorm on V . 

Now suppose that is a topological vector space and that U is an open 
subset of V such that e C/ and U is convex. In the case where the scalars 
are real numbers, if we put 

(2.24) Ui = Ur\{-U), 

then Ui is an open subset of V such that 0G?7i,f/iC[/, f/^^is convex, and 
Ui is symmetric. In the case where the scalars are complex numbers, if we 
put 

(2.25) C/i = {v e y : ^ V e [/ for all ^ e C such that |^| = 1}, 

then one can check that Ui is an open subset of V such that e C/i, C/i C [/, 
Ui is convex, and Ui is circular. In both cases we have that the Minkowski 
function Hui{v) is a continuous function on V whose open unit ball is con- 
tained in U. From this it follows that every locally convex topological vector 
space can have the topology described by a family of seminorms. 

2.3 Bounded subsets of a topological vector 
space 

Let y be a topological vector space, and let £^ be a subset of V. We say 
that E is bounded if for every open subset U oiV such that e C/, there is 
a positive real number t so that E CtU. Notice that a compact subset of V 
is bounded. 

If is a normcd vector space, so that the topology of V comes from a 
norm N{v) on V, then it is not hard to sec that a subset ii^ of is bounded 
if and only if the set of real numbers N(v), v E E, is bounded from above. 
More generally, if the topology on V comes from a nonempty family of 
seminorms on V, then is a bounded subset of V if and only if for each 
seminorm N in J-" the set of real numbers N[v), v E E, is bounded. 

Suppose that E is a. bounded subset of V. It is easy to see that aE is 
then bounded for all scalars a. Let us check that the closure E oi E is also 
bounded. Let W be any open subset of V such that e W. We would like 
to show that there is a positive real number t such that E C t W. To do this 
we use the fact that there is an open subset U of V such that E U and 
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U C W. Because E is bounded, there is a positive real number t such that 
E <ZtU, and that imphes that E CtW. 

Now assume that Ei, E2 are bounded subsets of V, and let us check that 
El U E2 is bounded. Let W be any open subset of V such that e W. We 
may as well assume that W is starhke around the origin. Since Ei, E2 are 
bounded, there are positive real numbers ti, t2 such that 

(2.26) El C ti W, E2 C t2 W. 
If we set t = max(ti, ^2), then 

(2.27) EiUE2CtW, 

which is what we wanted. 

Next, if El, E2 are nonempty bounded subsets of V, then the sum El + E2 
is a bounded subset of V too. To see this, let W be an open subset of V such 

that E W, and let Ui, U2 be open subsets of V such that e t^i, f/2, each 
of Ui, U2 is starlikc around the origin, and f/i, U2 ^ W . Because Ei, E2 are 
bounded, there are positive real numbers ti, t2 such that 

(2.28) EiCtiUi, E2Qt2U2. 

The starlikeness conditions imply that \it = max(ti,t2), then 

(2.29) EiCtUi, E2QtU2. 
Hence 

(2.30) Ei + E2QtUi + tU2QtW, 

which is what we wanted. 

In a locally convex topological vector space, the convex hull of a bounded 
set is also a bounded set. 

Suppose that F is a topological vector space, and that [/ is a nonempty 
open subset of V which is bounded. This is a strong condition. By translation 
we may assume that e C/. One can check that the family of sets of the 
form 

(2.31) - [/, n e Z+, 

n 

forms a local basis for the topology of at 0. If there is a bounded nonempty 

convex open subset of V , then it follows that there is a norm on V so that 
the topology defined by the norm is the same as the topology that is given. 
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2.4 Countability conditions and topological 
vector spaces 

When a topological space satisfies the first axiom of countability, it has the 
nice property that sequences are enough to describe the topology, in the sense 
that closed subsets can be characterized in terms of convergent sequences, for 
instance. In the context of topological vector spaces, we shall be concerned 
with two basic scenarios, where the space itself satisfies the first axiom of 
countability, and when suitably restricted subsets satisfy the first axiom of 
countability as topological spaces themselves. In this section we shall con- 
centrate on the first case, where a topological vector space itself satisfies the 
first axiom of countability. 

Let V he a topological vector space, and assume that V satisfies the first 
axiom of countability at 0, so that there is a sequence of open sets in V 
which contain and form a basis for the local topology at 0. This implies 
that V satisfies the first axiom of countability at all of its points, since one 
can translate the sequence of open sets around to any point in V. In other 
words, if Bo is a local basis for the topology of V at 0, then 

(2.32) B, = {v + U:Ue Bo} 

is a local basis for the topology of V ai v E V. If the topology on V can be 
defined by a norm, or if V has a nonempty bounded open subset, or if the 
topology on V can be defined by an at most countable family of seminorms, 
then V satisfies the first axiom of countabihty. 

A basic result states that when \^ is a topological vector space which 
satisfies the first axiom of countability, there is a metric on V, which is in 
fact invariant under translations, such that the topology determined by the 
metric is the same as the one on V already. In general this metric may not 
come from a norm, or something like that, however. I like to not take this 
route, unless there is a nice metric with some nice features, or something 
along those lines, but instead pretty much do the same things directly, in 
terms of the objects available, which may have quite nice properties. Of 
course if there is a nice metric around, translation-invariant in particular, 
say, then one would like to do things in a way which is compatible with the 
metric. 

As a basic instance of this, let us say that a sequence {zj}'^^ in y is a 
Cauchy sequence if for each open subset U of V such that e t/ there is a 
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positive integer N such that 

(2.33) Zj -zieU for all j, / > N. 

This definition makes sense in any topological vector space, but behaves 
better when something like the first axiom of countability holds. Observe that 
if {zj}^^i converges to some point in then {zj}'^^ is a Cauchy sequence. 
Note that if V is equipped with a translation-invariant metric which defines 
the topology on V, then this notion of a Cauchy sequence and the usual one 
defined using the metric are equivalent. 

A topological vector space which satisfies the first axiom of countability 
and in which every Cauchy sequence converges is said to be complete. A 
normed vector space which is complete is called a Banach space. A vector 
space equipped with a countable family of seminorms yielding a complete 
topological vector space is called a Frechet space. 

Let y be a topological vector space which satisfies the first axiom of 
countability at 0, and let Bq be a countable collection of open subsets of V 
which contain and form a local basis for the topology at 0. Suppose that V 
is separable as a topological space, so that there is a countable dense subset 
E of V. Consider the countable family of open subsets of V given by 

(2.34) {x + U : X e E,U e Bo}. 

Let us show that this family is a basis for the topology of V, and hence that 
V satisfies the second axiom of countability. 

Let y be any point in V and let W be an open subset of V such that 
y eW. We would like to find an x e E and a,U E Bq such that 

(2.35) ye x + U, x + U gW. 

Since —y + 1^ is an open subset of V which contains 0, there is a f/ G i3o so 
that U + U <^ -y + W, which is to say that y + U + U CW. Since y + U is 
a nonempty open subset of V, there is an x & E such that x & y + U. Hence 

(2.36) x + U Cy + U + U CW, 
as desired. 
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2.5 Continuous linear mappings 

Let Vi, V2 be topological vector spaces, both real or both complex. Since Vi, 
V2 are vector spaces, it makes sense to talk about linear mappings from Vi 
to V2, and since Vi, V2 are topological spaces it makes sense to talk about 
continuous mappings from Vi to V2. We can also talk about continuous linear 
mappings, which wc shall consider now. 

Suppose that / is a linear mapping from Vi to V2. To say that / is 
continuous at in Vi means that for every open subset of V2 which contains 
there is an open subset U of Vi which contains such that 

(2.37) /([/) C W. 

It is easy to see that this implies that / is continuous everywhere on Vi, 
because of linearity. 

For any mapping h from Vi to V2, we can define uniform continuity to 
mean that for every open subset W of V2 such that & W there is an open 
subset U of Vi such that e t/ and 

(2.38) h{x) - h{y) e W for all x,y eV^ with x - y E U. 

This is analogous to the notion of uniform continuity for mappings between 
metric spaces, and if V^i, V2 are equipped with translation-invariant metrics 
which define their topologies, then the two notions of uniform continuity 
are equivalent. A continuous linear mapping from Vi to V2 is automatically 
uniformly continuous. Just as for continuous mappings, notice that sums and 
scalar multiples of uniformly continuous mappings are uniformly continuous. 

The vector space of continuous linear mappings from Vi to V2 is denoted 
CC{Vi,V2). For a single topological vector space V we may write CC{V) 
instead of CC{V, V). Note that if Vi, V2, V3 are topological vector spaces, all 
real or all complex, and if /i is a continuous linear mapping from Vi to V2 
and /2 is a continuous linear mapping from V2 to V3, then the composition 
/2 o /i is a continuous linear mapping from Vi to V3. In particular, for a 
single topological vector space, composition of elements of CC{V) again lie 
in CC{V). 

If is a topological vector space, then the continuous dual of V is denoted 
V* and defined to be CC{V,'R) when y is a real vector space and to be 
CC{V, C) when V is a. complex vector space. Thus V* is a real vector space 
when V is a real vector space and V* is a complex vector space when V is a. 
complex vector space. 
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Let Vi, V2 be topological vector spaces again, both real or both complex. 
A linear mapping / from Vi to V2 is said to be bounded if for every bounded 
subset E of Vi we have that f{E) is a bounded subset of V2. It is easy to see 
that continuous linear mappings are bounded. 

The space of bounded linear mappings from Vi to V2 is denoted BjC{Vi, V2). 
As before, for a single topological vector space V we may write BC{V) rather 
than BC{V, V). Notice that sums and scalar multiples of bounded linear map- 
pings from Vi to V2 are again bounded, so that BC{Vi, V2) is a vector space 
in a natural way. Since continuous linear mappings are bounded, CC{Vi, V2) 
is a linear subspace of BC{Vi, V2). 

If Vi, V2, V3 are topological vector spaces, all real or all complex, and if fi 
is a bounded linear mapping from Vi to V2 and /2 is a bounded linear mapping 
from V2 to V3, then the composition /2 0/1 is a bounded linear mapping from 
Vi to V3. This is easy to see from the definitions. In particular, for a single 
topological vector space V, compositions of elements of BCiV) are again 
elements of BCiV). 

If y is a topological vector space, then the bounded dual is denoted V'' 
and defined to be BC{V, R) when ^ is a real vector space and to be BC{V, C) 
when F is a complex vector space. Thus is a real vector space when V is 
a real vector spave and V'' is a complex vector space when y is a complex 
vector space. In both cases the continuous dual V* is a linear subspace of 
the bounded dual V''. 

If Vi, V2 are topological vector spaces, both real or both complex, and if 
Vi contains a nonempty bounded open subset, then it is easy to check that 



In particular, this holds when Vi is a normed vector space. If both Vi, V2 are 
normed vector spaces, with norms A^^i, N2, then the condition of boundedness 
for a linear mapping / from Vi to V2 can be expressed succinctly by the 
statement that there is a nonnegative real number C such that 



for all V eVi. 

Suppose that Vi, V2, and V3 are vector spaces, all real or all complex, 
equipped with norms A^i, A'2, N3, respectively. Let /i be a bounded linear 
mapping from Vi to V2, and define the corresponding operator norm of /i by 



(2.39) 



BC{Vi,V2)=CC{Vi,V2). 



(2.40) 



N2if{v))<CN^{v) 



(2.41) 




sup{N2{fi{v)):veV^,N,{v)<l}. 
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It is not difficult to show that this does define a norm on the vector space 
BC{Vi, V2). Let /2 be a bounded hnear mapping from V2 to V3, and define 
the corresponding operator norm ||/2||op,23 analogously. The operator norm 
II • 1 1 op, 13 for bounded linear mappings from Vi to V3 can be defined in the 
same way, and one can check that 

(2.42) ||/2oMU,,i3< ll/ill op,12 II/2II 

If Vi, V2 are vector spaces, both real or both complex, equipped with 
norms A^i, N2, and if V2 is complete with respect to this norm, which is to 
say that it is a Banach space, then BjC{Vi,V2), equipped with the operator 
norm described in the previous paragraph is also complete, and hence defines 
a Banach space. For if {T,}°^]^ is a Cauchy sequence of bounded linear 
mappings from Vi to V2, then {Tj{v)}'j^i is a Cauchy sequence of elements 
of V2 for each v E Vi, and hence converges in V2. If we denote the limit as 
T(v), then one can check that T{v) is a bounded hnear mapping from Vi to 
V2, and that {Tj}'^^ converges to T with respect to the operator norm. 

What about analogous topologies on i3£(Vi, V2), CC{Vi,V2) for topolog- 
ical vector spaces Vi, V2, both real or both complex, more generally? This 
can be a somewhat tricky issue, and so we only mention a few basic points. 

If there is a nonempty bounded open subset of Vi, then BjC{Vi,V2) — 
CjC{Vi, V2), and one can follow similar ideas as for the case of normed vector 
spaces. Namely, the operator norm topology in the case of normed vector 
spaces basically looks at the size of a bounded linear operator on, say, the 
unit ball in the domain Vi , which then limits the size on all of Vi by linearity. 
If Vi has a nonempty open subset U, which we may as well assume contains 
0, then we can look at the size of a bounded linear operator T from Vi to V2 
in terms of the size of T on U, noting that T{U) will be a bounded subset 
of V2. This is especially simple if V2 also contains a nonempty bounded open 
subset W, which we may assume contains 0, because we can then look at for 
which positive real numbers r we have T{U) C r W. In general, we can look 
at the size of T in terms of which open subsets of V2 contain T{U), which 
dilations of them do, etc. 

In general one can try to measure the size of a bounded linear operator 
T from Vi to V2 in terms of the size of T on bounded subsets of Vi. That 
is, if £■ is a bounded subset of Vi and W is an open subset of V2 which 
contains 0, one can ask whether T(E) C W, look at the set of r > such 
that T{E) C rW, and so on. However, one may need to consider families of 
choices of E and W. 
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3.1 spaces, 1 < p < oo, and cq 

If p is a real number such that 1 < p < oo, define ^^(R), ^^(C), respectively, 
to be the space of sequences x — {xj}'^i with values in R, C, respectively, 
such that 

oo 

(3.1) Ek.r<~- 

i=i 

For X = {xj}°°^^ in £p(R), £p(C), we put 




When p = oo, we define £°°{'R), £°°{C), respectively, to be the space of 
sequences x — {xj}'^i with values in R, C, respectively, which are bounded, 
i.e., whose values are contained in a bounded set. In this case we set 

(3.3) ||x||oo = sup{|xj| : j e Z+} 

for X = {xj}'^^ in £°^(R) or £°°(C). When p = oo we can also consider the 
spaces co(R), co(C), respectively, of sequences x — {xj}'^i with values in R, 
C, respectively, such that 

(3.4) lim Xj = 0. 

j— ►oo 

Such a sequence is bounded in particular, so that 

(3.5) Co(R) C £-(R), co(C) C £-(C). 
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It is easy to see that £^(R), £^(C) are real and complex vector spaces 
for all p, 1 < p < oo, and that Co(R), Co(C) are linear subspaces of £°°(R), 
£~(C), respectively. Clearly ||a;||p > for alia; in £*'(R), ^^(C), with ||a;||p = 
if and only if x = 0, and 

(3.6) l|Q;a;||p = |q;| \\x\\p 

when q; is a real or complex number and x is an element of £^(R) or £^(C), 
respectively. When p — 1 one can check directly from the definition that 
satisfies the triangle inequality, and hence defines a norm on ^^(R), i^{C). 
One way to see this when 1 < p < oo is to check that the set of x in £^(R) or 
in £^(C) such that \\x\\p < 1 is a convex set. This is not difficult to do, using 
the fact that is a convex function on the set of nonnegative real numbers. 

Thus ^^(R), i^{C) are normed vector spaces for 1 < p < oo. Also co(R), 
co(C) arc normed vector spaces with respect to the norm ||x||oo- One can 
show that if 1 < p < g < oo, then 

(3.7) F{K) C ^^(R) C co(R) C £~(R), 

(3.8) iP{C) C ii{C) C co(C) C r{C), 

and 

(3.9) ||*^l|oo — 11*^11^ — 

when X is an element of ^^(R), i^{C). 

Notice that ^^(R), i^{C) are complete, in the sense that every Cauchy 
sequence converges. Let us sketch the argument. Suppose that {x{l)}iZi is a 
Cauchy sequence in one of these spaces, so that for each Z, x{l) — {xj{l)}'jLi 
is itself a sequence of real or complex numbers. Because of the way that the 
norm is defined, one can check that {xj{l)}f^i is a Cauchy sequence as a 
sequence of real or complex numbers for each positive integer j, and hence 
converges as a sequence of real or complex numbers to some Xj. Thus we get 
a sequence x — {xj}'j?^i, and one can show that this x lies in the space 
and is the limit of the sequence {x{l)}'j^-^ in the space. 

One can also show that Co(R), Co(C) are closed linear subspaces of £°°(R), 
i^{C)j and hence arc complete as topological vector spaces in their own right. 
This is not hard to do. 

For the spaces when 1 < p < oo and for the cq spaces, the hnear 
subspaces consisting of sequences x = {xj}"^^ such that Xj = for all but 
at most finitely many j are dense. This is not the case for the i°° spaces, for 
which the closure of this subspace is the corresponding cq space. As a result. 
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the spaces for 1 < p < oo and the cq spaces are separable, which is to say 
that they contain countable dense subsets, and therefore satisfy the second 
axiom of countabihty. 

The inclusions fj3.7|) . ()3.8p can be viewed as bounded linear mappings be- 
tween the £P and Cq spaces. Another natural class of bounded linear mappings 
from the or cq spaces into the same space again are given by multiplication 
by a bounded sequence. One can also map and cq spaces into P spaces by 
multiplication by a sequence in i^, to get a bounded linear mapping. Next 
we describe a class of bounded linear mappings from spaces to other l"^ 
spaces, using Holder's inequality, which we review first. 

Suppose that po, go are real numbers such that 1 < po, qo < oo and 

1 1 

3.10 — + - = 1. 

Po qo 

Let {xj}"^^, {yj}'jLi be sequences of nonnegative real numbers such that 

oo oo 

(3.11) Ei/f 

j=i j=i 

Holder's inequality states that 

oo . oo . 1/po . oo ^ l/gj, 

(3.12) E^.%< E^r [T.yr 

j=l ^k=l ^ \=\ 

and in particular that the sum on the left converges. 
To see this, one can start with the inequahty 

(3.13) ah<—^ — 

Po qo 

for nonnegative real numbers. We leave this inequality as an exercise. As a 
consequence, 

oo 1 oo -| oo 

(3.14) E^.%<-E^f + -E?/r- 

j=l Po k=l 10 1=1 

One can derive Holder's inequality from this using homogeneity considera- 
tions, which is to say by multiplying the x/s and yi's by positive real numbers. 

As a consequence of Holder's inequality, if p, q, and r are positive real 
numbers such that 

1 1 1 

3.15 - = - + -, 

r p q 
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and if {uj}j?^i, {wj}j?^i are sequences of nonnegative real numbers such that 

oo oo 

(3.16) E«?'E^I<°°' 

i=i i=i 



then 



/ oo s 1/r . oo s l/p . oo ^l/q 

(3.17) E(«.-^.r ^(e«? (e-''' 

and in particular the sum on the left converges. This leads to bounded hnear 
mappings from £p to by multiplication by sequences in when p, q, and 
r arc as above and r > 1. 

Let us mention two other types of bounded linear operators on the 
and Co spaces, namely, backward and forward shift operators. If {xjjj^i is 
a sequence of real or complex numbers, then the backward shift operator 
sends this sequence to {xj+i}^^, which has the effect of dropping the first 
term. On each space, and on the Cq spaces, this defines a bounded linear 
operator from the space onto the same space, with operator norm 1, and 
with a 1-dimensional kernel or nuUspace consisting of the sequences {xjy'jL^ 
such that Xj — when j > 2. The forward shift operator takes a sequence 
{xj}jti and sends it to the sequence with first term equal to and with jth 
term equal to Xj-i when j > 2. This defines a bounded linear operator on 
each space and on the cq spaces, which is an isometry, in the sense that the 
norm is preserved, and which maps the space onto the subspace of sequences 
whose first term is equal to 0. 

One can also consider doubly- infinite sequences {xj}'^_^ of real and 
complex numbers, and the corresponding and cq Banach spaces. For these 
spaces we have the same kind of inclusions and multiplication operators as 
before. The backward and forward shift operators now define isometric linear 
mappings of these spaces onto themselves. 

If V is any topological vector space, one can define £'p{V) in a natural 
way as a generalization of ^^(R), -^^(C). This is simplest when V is equipped 
with a norm N. In this case we can define £^\V) to be the vector space 
of sequences {xj}'^^ with terms in V such that the sequence {N{xj)}'^i 
of norms of the xj's lies in £^(R). We can define the £p{V) norm of such 
a sequence to be the £^(R) norm of {N{xj)}jli, and indeed one can check 
that this does define a norm on £p{V). Similarly, we can define Cq{V) as a 
closed subspace of £'^{V), consisting of the sequences {xj}'j^i in V such that 
{N{xj)}'^^^ lies in co(R). 
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In general for a topological vector space V, we can take i°°(y) to be the 
vector space of sequences {xj}'jLi in V which are bounded, in the sense that 
there is a bounded subset of V which contains all the terms of the sequence. 
We can define Co{V) to be the space of sequences in V which tend to in 
V, and iP{V) to be the space of sequences {xj}j^i such that for every open 
subset U oi V which contains there is a sequence of positive real 

numbers in £^(R) such that Xj G rjU for all j. Alternatively one might 
define Co{V), £^{V) to be the spaces of sequences {xj}j^i in V which can be 
expressed as {TjVj}j?^i, where {rj}°2=i is a sequence of positive real numbers 
in Co(R), -^^(R), respectively, and {vj}j^-^ is a bounded sequence in V. 



3.2 £P spaces, < 1 

Just as when p > 1, for a real number p such that < p < 1, let us define 
£^(R), i^{C), respectively, to be the spaces of sequences x = {xjj'j^^ with 
values in R, C, respectively, such that 

oo 

(3.18) Y^\xj\P<oo. 

When X — {xj}'jLi is an element of ^^(R) or -^^(C), we again set 

(3.19) EK-r 

It is easy to see that ^^(R), £^{C) are real and complex vector spaces, 
respectively, when < p < 1. Also ||a;||p > for all x in £^(R), ^^(C), 
\\x\\p = if and only if x = 0, and 



(3.20) l|c>; ^IIp = 



p 



for all real or complex numbers a and all x in £^(R) or i^{C), respectively. 
It is not the case that ||a;||p is a norm on ^^(R) or £^{0) when < p < 1, 
however, because the triangle inequality does not hold. There is a substitute 
for this, which is that 

(3.21) \\x + y\\l<\\x\\l + \\yrr, 

for X, y in £^(Il) or in £^{C), < p < 1. One sometimes calls this the 
p-triangle inequality, and says that \\x\\p is a p-norm. 
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The p-triangle inequahty imphes that 

(3.22) Wx-yW; 

defines a metric on F(R), £p(C), and it is not difficult to see that ^^(R), iP{C) 
become topological vector spaces with respect to this topology. Analogous 
to the situation for a normed vector space, a subset E of £^(R), £^(C) is 
bounded in the sense for topological vector spaces if and only if it is bounded 
in the sense for metric spaces, which is to say that the set of nonnegative 
real numbers 

(3.23) {\\x\\p : X e E} 
is bounded from above. The open unit ball 

(3.24) {x G F{R) : < 1} 

in £^(R) is a bounded open subset of £p(R) which contains 0, is starlike 
around 0, and is symmetric, and the open unit ball 

(3.25) {xeF{C):\\x\\p<l} 

in £P(C) is a bounded open subset of £^(C) which contains 0, is starlike 
around 0, and is circular. 

When < p < 1, one can check that the convex hull of the open unit ball 
in £^(R), £^(C) contains the set of real or complex sequences y = {yj}'jLi, 
respectively, such that yj = for all but finitely many j and 

oo 

(3.26) \\y\U = Y.\y,\<l. 

i=i 

As a result, the convex hull of the open unit ball in £^(R), £^{C) is not 
bounded. Thus ^^(R), ^^(C) are not locally convex when < p < 1, and in 
particular the topology on them does not come from a norm. 

Let us mention that for i^{C) there are natural pseudoconvexity proper- 
ties of the unit ball, in terms of complex analysis. The function ||f ||p enjoys 
corresponding plurisuhharmonicity properties rather than convexity. Com- 
pare with [31211123. 

If < p < g < 1, then 



(3.27) 



F(R) C £'?(R) C £i(R) 
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and 

(3.28) F(C) C £«(C) C i\C), 
and for x in ^^(R), ^^(C), we have that 

(3.29) ||x||i < \\x\\g < \\x\\p. 

Just as when p > 1, one can show that these spaces are complete. Also, 
the linear subspaces of the spaces consisting of sequences x = {xj}"^^ such 
that Xj = for all but at most finitely many j's are dense, and as a result the 
spaces are separable, and satisfy the second axiom of countability, when 
< p < 1. 

The inclusions fj3.27|) and ()3.28p can be interpreted again as defining 
bounded linear operators between the £^ spaces. Just as before, one has map- 
pings between £^ spaces coming from multiplications. One also has backward 
and forward shift operators as before. 

One can also consider iP{V) for topological vector spaces V, in essentially 
the same manner as when p > 1. 

3.3 Continuous functions on 

Let n he a. positive integer, and let C(R", R), C(R", C) denote the real and 
complex vector spaces of real and complex-valued continuous functions on 
R", respectively. 

For each positive integer j, define Nj{-) on C(R"', R), C(R", C) by 

(3.30) iV,(/) = sup{|/(x)| : a; G R", |a;| < j} 

when / is a continuous real or complex- valued function on R". It is easy to 
see that this defines a seminorm on C(R", R), C(R", C), and that Nj{f) = 
for all j G Z+ if and only if / = on R"-. Thus A''^-, j G Z_|_, determine 
topologies on C(R", R), C(R", C), in such a way that they become real and 
complex locally- convex topological spaces. 

If is a subset of C(R", R) or C(R", C), then E is bounded with respect 
to the topology on the corresponding vector space just defined if and only if 
for each j the set of nonnegative real numbers 



(3.31) 



{N,{f):feE} 
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is a bounded set of real numbers. Let us emphasize that the upper bounds 
for these sets are permitted to depend on j. 

Using this description of the bounded subsets of C(R", R), C(R", C), it 
follows that these topological vector spaces do not contain nonempty open 
subsets which are bounded. In particular, there is no single norm on C(R", R) 
or C(R", C) which defines the same topology. 

Let {fk}'kLi be a sequence of functions in C(R"', R) or C(R", C), and let 
/ be another function in the same space. Then converges to / in the 

space if and only if 

(3.32) hm sup{|/fe(x) - f{x)\ : x e R", \x\ < j} = 

K—*00 

for all positive integers j. This is the same as saying that {fkjkLi converges 
to / uniformly on every bounded subset of R". 

Now suppose that {fk}'kLi is a sequence of functions in C(R"', R) or 
C(R", C) which is a Cauchy sequence. Explicitly, this means that for ev- 
ery e > and every positive integer j there is a positive integer L such 
that 

(3.33) \fk{x) - fi{x)\ < € when x e R", \x\ < j, and k,l > L. 

In particular, {/fc(a:)}^i is a Cauchy sequence of real or complex numbers 
for each x G R", which therefore converges to a real or complex number, 
as appropriate, which we can denote f{x). One can then show that / is a 
continuous function on R", and that {fk}'kLi converges to / uniformly on 
bounded subsets of R". Thus C(R", R), C(R", C) are complete, so that they 
are in fact Prechet spaces. 

Let us write P(R", R) , ^(R", C) for the vector spaces of real and complex- 
valued polynomials on R", respectively. Thus, 

(3.34) V{W, R) C C(R", R), P(R", C) C C(R", C). 

In fact, P(R", R), V(W, C) are dense in C(R'', R), C(R", C), respectively. 
Indeed, if / is a continuous function on R", then for each positive integer j 
there is a polynomial Pj on R"^ such that 

(3.35) \f{x) - Pj{x)\ <j for aU a; e R", < j, 

since continuous functions on compact subsets of R" can be approximated 
uniformly by polynomials. Hence {Pj}'^^ converges to / uniformly on bounded 
subsets of R", which implies the above-mentioned denseness result. 
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Using this, one can show that C(R"^, R), C(R", C) contain countable dense 
subsets, so that they are separable. This implies that they satisfy the second 
axiom of countability. This might seem a bit surprising, and one might say 
that these spaces and the topologies on them balance each other in a nice 
way. 

If f{x) is a real or complex- valued function on R", then the support of /, 
denoted supp /, is defined to be the closure of the set of points x G R" such 
that f{x) ^ 0. Let us write Coo(R", R), C^R"", C) for the real and complex 
vector spaces of real and complex- valued continuous functions on R" with 
compact support. Of course 

(3.36) Coo(R", R) C C(R", R), Coo(R", C) C C(R", C). 

For each positive integer I, let (f)i{x) be a continuous real- valued function 
on R" such that (f)i{x) = 1 when |a:| < I, (f)i{x) — when \x\ > I + 1, 
and < < 1 for all x G R". If / is a continuous real or complex- 

valued function on R", then the sequence of products {4>i fjfZi is a sequence 
of continuous functions with compact support on R" which converges to / 
uniformly on every bounded subset of R". Thus Coo(rt") R-)) Coo(R"', C) are 
dense subspaces of C(R"^, R), C(R", C), respectively, and this can be used to 
give an alternate approach to the separability of the latter spaces. 

For each nonempty compact subset K of R", define C{K, R), C{K, C) to 
be the real and complex vector spaces of real and complex- valued continuous 
functions on K, respectively. On these spaces we have the supremum norm 
WfWsup defined by 

(3.37) \\f\Uup^sup{\f{x)\:xeK}. 

It is easy to sec that the supremum norm does indeed define a norm on 
C{K, R), C{K, C), and it is well known that C{K, R), C{K, C) are complete 
with respect to the supremum norm, and therefore become Banach spaces. 
Of course convergence of a sequence of functions on K in the supremum norm 
is the same as uniform convergence. 

For each nonempty compact subset K of R" we get linear mappings 

(3.38) C(R", R) ^ C{K, R), C(R", C) ^ C(R", C) 

defined by taking a continuous function / on R" and simply restricting it to 
a continuous function on K. There are well-known extension results which 
say that every continuous function on K can be realized as the restriction 
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to -fC of a continuous function on R", so that the mappings in ()3.38j] are 
surjections. In fact there are continuous hnear extension operators 

(3.39) C{K, R) ^ C(R", R), C{K, C) ^ C(R", C) 

such that the compositions of these mappings with the restriction mappings 
are equal to the identity mapping on C{K, R), C{K, C), respectively. 

Let us be a bit more precise. Let Ki be a compact subset of R" such 
that K is contained in the interior of Ki. The linear extension operators just 
mentioned can be chosen so that continuous functions on K are extended 
to continuous functions on R" which are supported in Ki. This can be 
obtained as a by-product of standard constructions of the extension operator, 
or arranged afterwards simply by multiplying by a continuous function on 
R*^ which is equal to 1 on and has support contained in Ki. It is easy to 
have the extension operators also have norm equal to 1 with respect to the 
supremum metric on the domain and range. 

Notice that for each a G R" the translation operator 

(3.40) f{x)^f{x-a) 

defines a continuous linear mapping from each of C(R", R), C(R", C) to itself. 
More generally, if p is a continuous mapping from R" to itself, then 

(3.41) fix) ^ f{p{x)) 

defines a continuous linear mapping from each of C(R", R), C(R", C) to itself. 
As another class of operators, if h{x) is a continuous real or complex-valued 
function on R", respectively, then 

(3.42) fix) ^ h{x) fix) 

defines a continuous linear mapping from C(R",R), C(R", C) to itself, re- 
spectively. 

One can also consider continuous functions with values in a topological 
vector space V. 



3.4 Rapidly decreasing continuous functions 
on 

Let f{x) be a real or complex-valued function on R". We say that f{x) is 
rapidly decreasing on R" if for every positive integer j there is a positive real 
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In other words, f{x) = 0((|a;| + l)^') for all positive integers j. The 
space of real- valued continuous rapidly decreasing functions on R" is denoted 
7^C(R",R), and the space of complex-valued rapidly decreasing continuous 
functions on R" is denoted 7^C(R", C). 

Clearly 7?X3(R", R), 7?X3(R", C) are real and complex vector spaces, with 
respect to ordinary addition and scalar multiplication of functions. On each 
of these spaces and for each positive integer j we can define the norm 



and this family of norms leads to a topology on each of 7^C(R", R), 7^C(R"', C) 
which makes these spaces locally convex topological vector spaces. 

Let CqoCR^, R), Coo(R'"'; C) be the real and complex vector spaces of real 
and complex- valued continuous functions on R", respectively, as in the pre- 
vious section. Also, for each positive integer /, let 4>i{x) be a continuous 
real- valued function on R" such that (f)i{x) = 1 when |a;| < /, (f)i{x) = when 

> / -|- 1, and < 0;(a;) < 1 for all x G R", again as in the previous sec- 
tion. If f{x) is a rapidly decreasing continuous function on R", then one can 
check that the sequence of products {0; converges to / in TZC{IC','R) 
or 7^C(R", C), as appropriate 

Thus Coo(R",R), Coo(R",C) are dense linear subspaces of 7^C(R",R), 
7^C(R",C), respectively. One can use this observation to show that the 
topological vector spaces TZCCR^, R), 7^C(R", C) are separable. As a result, 
they satisfy the second axiom of countability. 

Suppose that {fk}'kLi is a sequence of real or complex-valued rapidly 
decreasing sequence of functions on R" which is a Cauchy sequence with 
respect to the family of norms Mj, j G Z_|_. This means that for each e > 
and each positive integer j there is a positive integer L such that 



(3.45) sup{|/fe(x) - fi{x)\ {\x\ + ly : X e R**} < e for all k,l>L. 



For each x e R", the sequence of real or complex numbers is then 

a Cauchy sequence as well, and hence converges. If we denote the limit f{x), 
then one can show that f{x) is a rapidly decreasing continuous function on 
R"^ and that {fk}kLi converges to / with respect to the norms Mj for each 



(3.43) 



|/(a;)| < C(j) (|x| + 1)^' for aU x e R". 



(3.44) 



M,-(/) = sup{|/(x)| {\x\ + ly : X e R"}, 
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positive integer j. Thus 7?XJ(R", R), 'RjC{'R"', C) are complete, and hence are 

Frechet spaces. 

Let E be a subset of 7^C(R", R) or nC{W, C). Then E is bounded in 
the sense of bounded subsets of topological vector spaces if and only if for 
every positive integer j the set of nonnegative real numbers 



is bounded from above. As a result, one can verify that nonempty open 
subsets of 7^C(R", R) and 7^C(R", C) are not bounded. 

The family of norms M, , j e Z+, has a nice feature, which basically says 
that the property of boundcdncss for a subset of 7^C(R",R), 7^C(R",C). 
Namely, if {fk}kLi is a bounded sequence in 7^C(R",R) or 7^C(R",R), so 
that {Mj(/fc)}^^ is a bounded sequence of real numbers for each j, and if 
{/fcjfeli converges uniformly on compact subsets of R" to a real or complex- 
valued function /, as appropriate, then / is rapidly decreasing and 
converges to / in the topology of rapidly decreasing functions. In other words, 
if £^ is a bounded subset of 7^C(R", R) or 7^C(R", C), then the topology on 
E inherited from the space of rapidly decreasing functions is the same as the 
topology on E inherited from C(R'*, R), C(R'*, C), as appropriate. 

Let X be a nonempty compact subset of R", and consider the restriction 
mappings 



i.e., the linear mappings which take a rapidly-decreasing continuous function 
/ on R" and restrict it to As in the previous section, C{K,'R), C{K,C) be- 
come normed vector spaces in a natural way by using the supremum metric. 
It is easy to see that the restriction mappings above are continuous map- 
pings, and in fact they map 7^C(R", R), 7^C(R", C) onto C{K, R), C{K, C). 
As in the previous section again, there are even bounded linear extension op- 
erators from continuous functions on K to continuous functions on R" with 
support contained in a compact subset Ki of R" such that K is contained 
in the interior of K, so that the extension operator from functions on K to 
functions on R" composed with the restriction operator from functions on 
R" to functions on K is the identity operator on functions on K. 

If h{x) is a continuous real or complex- valued function of moderate growth, 
in the sense that there is a positive integer I and a nonnegative real number 
C such that 



(3.46) 



{M,(/) -.feE} 



(3.47) 



7^C(R",R) ^C(X,R), 7^C(R",C) ^C(X,C), 



(3.48) 



\h{x)\ < C(l + |a;|) 
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for all X e R", then the multiplication operator 

(3.49) fix) ^ h{x) fix) 

defines a continuous linear mapping from 7^C(R"',R), 7^C(R"', C) to itself, 
respectively. This is not hard to check from the definitions. If (pix) is a real 
or complex- valued continuous function on R" with compact support, then 
the multiplication operator 

(3.50) fix) ^ (Pix) fix) 

defines a continuous linear mapping from C(R", R), C(R"', C) to 7^C(R"', R), 
TZCiR"', C), respectively. Of course the range of this mapping is contained in 
the space of real or complex- valued continuous functions on R", respectively, 
with support contained in the support of 0. Also, the obvious inclusions of 
7^C(R",R), 7eC(R",C) into C(R'*,R), C(R",C), respectively, are continu- 
ous linear mappings. 

If a e R", then the translation operator 

(3.51) fix) ^ fix - a) 

defines a continuous linear operator on each of 7?.C(R",R), 7?^(R", C). If 
A is an invertible linear mapping of R" onto itself, then the composition 
operator 

(3.52) fix) ^ fiAix)) 

defines a continuous linear operator on each of 7^C(R", R), 7^C(R", C). Com- 
positions with continuous mappings from R" to R" do not quite work in 
general, but they do work under reasonable conditions. 

3.5 Normed and topological algebras 

Let ^4 be a vector space. Suppose that in addition to the vector space opera- 
tions there is another binary operation on A which one can call a "product" 
which satisfies the usual associative law, the usual dsitributive laws with re- 
spect to addition on A, and the usual compatibility conditions with respect 
to scalar multiplication, so that scalar multiplication commutes with mul- 
tiplication on A. Then we say that A is an algebra. For instance, if V is 
a vector space, then the vector space CiV) of linear mappings from V into 
itself is an algebra, using composition of linear operators as multiplication. 
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Suppose in addition that A is a topological vector space, and that the 
operation of multiplication is a continuous mapping from A to A. Then A 
is said to be a topological algebra. If the topology on A is determined by a 
norm || ■ ||, and if 

(3.53) ||a6|| < ||a|| ||6|| 

for all a,b & A, i.e., the norm of a product is less than or equal to the product 
of the corresponding norms, then we say that ^4 is a normed algebra. This 
condition implies that multiplication is continuous on A. 

A number of examples of these notions occur in this chapter. The algebra 
of bounded linear operators on a normed vector space is a normed algebra, 
with respect to the corresponding operator norm. Even if there is not a norm 
available, there are various ways in which algebras of bounded or continuous 
hnear operators on a topological vector space can be topological algebras. 



Chapter 4 
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If f{x) is a real or complex- valued continuous function on a topological space, 
like R", then the support of /, denoted supp/, is defined to be the closure 
of the set of x e R"' such that f{x) ^ 0. 

4.1 Continuous functions with compact sup- 
port on 

As before, we write Coo(R", R), Coo(R", C) for the spaces of real and complex- 
valued continuous functions on R" with compact support, respectively. Let 
us also write Co(R", R), Co(R", C) for the spaces of real and complex-valued 
continuous functions / (x) on R" which "vanish at infinity" , in the sense that 
for every e > there is a compact subset K of R" such that 



These are all clearly real and complex vector spaces with respect to the usual 
operations of addition and scalar multiplication of functions, and 



Functions in Co(R",R), Co(R"; C) are bounded in particular, and thus we 
may define their supremum norms as usual by 



(4.1) 



|/(a;)| < e for all x e R"\i^. 



(4.2) 



Coo(R"', R) Q Co(R"', R), Coo(R"', R) Q Co(R"', C). 



(4.3) 



11/11 



sup 



sup{|/(x)| : X e R"}. 
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The spaces Co(R"', R), Co(R", C) are complete with respect to the supre- 
mum norm. In other words, suppose that is a Cauchy sequence in 

one of these spaces, so that for every e > there is a positive integer L such 
that 

(4.4) Wfj - fiWsup < e for all j, I > L. 

This imphes that for each x e R" the sequence {fj{x)}^-^ is a Cauchy 
sequence of real or complex numbers, and hence converges. If we denote the 
limit f{x), then one can show that f{x) is continuous function on R" which 
vanishes at infinity, and that converges to / uniformly on R'^. Thus 

converges to / in Co(R", R) or Co(R", C), as appropriate. 

The linear subspaces Coo(R"',R), Coo(R"', C) are dense in Co(R",R), 
C(R"^, C), respectively. To see this, for each positive integer j, choose a real- 
valued continuous function (pjix) on R" such that 4>j{x) = 1 when |a;| < j, 
0j(x) = when |x| > j + 1, and < (pj{x) < 1 for all x G R". If f{x) is a 
function in Co(R", R) or C(R", C), then the sequence {4>j converges to 

/ in the supremum norm, and of course 4>j{x) f{x) is a continuous function 
on R" with compact support for each j too. 

On the other hand, we can be interested in some kind of topological 
structure on Coo(R", R), Coo(R", C) so that they arc already complete, i.e., a 
"finer" topological structure. Here are three basic features of such a structure. 
First, a subset E of Coo(R'*, R), Coo(R", C) would be bounded if and only if 
there is a compact subset K of R" such that each function f in E has support 
contained in E. and the collection of supremum norms of functions f in E 
is a bounded set of real numbers. Second, a sequence of functions {fj}j^i in 
Coo(R",R), Coo(R",C) would be considered to converge to a function / in 
the same space if there is a compact subset K of R" such that the support of 
each fj and o / is contained in K, and if converges to / uniformly. 

Third, a sequence in Coo(R"',R), Coo(R",C) would be considered a 

Cauchy sequence if there is a compact subset K of R" such that the support 
of each fj is contained in K and if {/jj^li satisfies the usual Cauchy sequence 
condition with respect to the supremum norm, in which case it follows that 
{fj}'jLi converges in the sense mentioned before. 

In fact, the idea of bounded or continuous linear functionals on Coo(R", R), 
Coo(R", C) behaves well and is quite interesting. Namely, a linear functional 
A on one of these spaces is considered to be bounded if for each compact 
subset K of R" there is a nonnegative real number Ck such that 



(4.5) 



|A(/)|<t^i. 11/11 
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whenever / is a continuous function with support in K. We consider A to be 
continuous if 

(4.6) Um A(/,) = A(/) 

J—>-oo 

whenever converges to / in the sense described in the previous para- 

graph. This is equivalent to saying that for each compact subset K of R'^, 
A is continuous on the normed vector space of continuous functions with 
support contained in K with respect to the supremum norm, and it is also 
equivalent to the boundedness condition above. 

Suppose that A is a bounded hnear functional on Coo (R'^, R) or Coo (R", C) . 
For each nonempty compact subset K of R"^, define Nk{X) to be the supre- 
mum of |A(/)| over all real or complex-valued continuous functions / on R", 
as appropriate, with 

(4.7) supp/CK and < 1. 

The boundedness of A implies that Nk{\) is finite for all compact subsets 
K of R". This gives a nice family of seminorms on the duals of Coo(R", R), 
Coo(R"^, C), and in fact the countable family N-^^^j^ j G Z_|_ is sufficient, for 
defining topologies on the duals of Coo(R", R), Coo(R", C). It is not difficult 
to sec that these dual spaces are complete, and hence are Prechet spaces. 

There is a natural way in which to define topologies on Coo(R"',R), 
Coo(R"', C) so that they become locally convex topological vector spaces with 
the kind of properties described above. These are basic examples of inductive 
limit spaces. This is a bit tricky, and we shall not pursue this here. 

4.2 Bounded continuous functions on 

Let C6(R",R), ^^(R", C) denote the real and complex vector spaces of real 
and complex-valued bounded continuous functions on R", respectively. Be- 
cause the functions are assumed to be bounded, the supremum norm is de- 
fined on Cfe(R", R), C6(R", C) as before, so that these spaces become normed 
vector spaces. Also, Cfe(R",R), Cfe(R", C) are complete with respect to the 
supremum norm, so that they are Banach spaces. 
Of course 



(4.8) Coo(R", R) Q Co{W, R) C C6(R", R) C C(R", R) 
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and 

(4.9) Coo(R", C) C Co(R", C) C Cb{R\ C) C C(R^ C), 

and these inclusions are all continuous. For each nonempty compact subset K 
of R", we also have the continuous linear mapping of restriction of continuous 
functions on R" to continuous functions on K, and we have mentioned before 
that for each compact subset Ki of R" such that K is contained in the 
interior of Ki there are continuous linear extension operators from continuous 
functions on K to continuous functions on R" with support contained in Ki. 
Actually, we have also discussed rapidly decreasing continuous functions on 
R", which include continuous functions with compact support and which 
are included among continuous functions which tend to at infinity in R"^, 
and in the next section we shall discuss continuous functions of polynomial 
growth, which include bounded continuous functions and are included in the 
space of continuous functions in general. 

Let us consider another way to think about topology and so forth on the 
spaces of real and complex- valued bounded continuous functions on R". Let 
£^ be a collection of such functions, and let us assume that E is bounded in 
the usual sense, so that 

(4.10) {WfWsup -.feE} 

is a bounded set of real numbers. On this set, let us use the topology from 
the space of continuous functions on R"' in general, rather than the topology 
induced by the supremum norm. 

Notice that Cb(W, R), ^^(R", C) are dense subspaces of C(R", R), C{W, C), 
respectively, and are not closed subspaces in particular. However, for each 
positive real number r, the collections 

(4.11) {/ea(R",R): 11/11,,^ <r} 
and 

(4.12) {/eC5(R",C):||/|U<r} 

arc closed subsets of C(R",R), C(R", C), respectively. This is not difficult 

to verify. 

Suppose that A is a linear functional on Coo(R", R) or Coo(R'^, C) which 
is bounded with respect to the supremum norm. This means that there is a 
nonnegative real number L such that 



(4.13) 



|A(/)|< ^11/11 
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for all / in Coo(R",R) or Coo(R"^,C), as appropriate. This is equivalent 
to saying that A extends to a continuous linear functional on Co(R",R) or 
Co(R'^,C), as appropriate. 

Let us assume that L is the smallest nonnegative real number for which 
the inequality above holds. This is the same as saying that L is the supre- 
mum of |A(/)| for all real or complex-valued continuous functions on R", as 
appropriate, which have compact support and satisfy ||/||sup < 1- Thus, for 
each e > 0, there is a continuous function /ig on R" with compact support 

such that < 1 and |A(/ie)| > L — e. 

Using these properties of it follows that if / is a continuous function 
on R" such that f{x) — for all x E and ||/||sup < 1, then 

(4.14) |A(/)|<e. 
Indeed, if a, /3 are scalars such that 

(4.15) H\f3\<l, 

then a f + (3 he is a. continuous function on R" with compact support such 
that 

(4.16) \\af + phe\\sup<l. 
Hence 

(4.17) \aX(f)+(3X(h)\<L, 

and one can use this to bound |A(/)|. 

From here it is not too hard to show that for each positive real number 
r the restriction of A to the collection of real or complex-valued continuous 
functions / on R" with compact support and ||/||snp < r is continuous with 
respect to the topology of C(R", R) or C(R", C), as appropriate. This topol- 
ogy is less restrictive than the one associated to the supremum norm. In 
other words, this is a stronger continuity property than the one that was 
explicitly assumed at the beginning. 

As a result, one can show that A extends to a linear functional on C(,(R", R) 
or C6(R", C) which is also continuous on each bounded subset with respect 
to the topology of C(R", R), C(R", C), as appropriate. We still have that 

(4.18) |A(/)|<L||/||,„, 

for all bounded continuous functions / now, i.e., with the same choice of L 
as before. This extension of A to bounded continuous functions on R" is 
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unique, basically because every bounded continuous function / on R" is the 
limit of a sequence {fj}'jLi of countinuous functions on R" with compact 
support such that the supremum norms ||/j||sup are uniformly bounded and 
the convergence is uniform on bounded subsets of R". 

If fi, /2 are bounded continuous functions on R", then the product fi /2 
is also a bounded continuous function on R", and 

(4-19) ||/i/2||sup< II /ill sup 11/2 II sup- 

Thus C6(R",R), Cb{IV^,C) are normed algebras. The product operation 
also behaves well in terms of continuity with respect to the less restrictive 
topologies from C{W, R), C(R", C). 



4.3 Continuous functions on of polyno- 
mial growth 

Let us define 7'C(R", R), PC(R", C) to be the real and complex vector spaces 
of real and complex- valued continuous functions f{x) on R", respectively, 
which have polynomial growth, which is to say that there is a nonnegative 
real number C and a positive integer j such that 

(4.20) \f{x)\<C(l + \x\y 

for all X e R"". Instead of defining topologies on VC{W, R), VC{W, C), let 
us make the conventions that a subset E of one of these spaces is bounded if 
there are choices of C,j so that each f & E satisfies the inequality above, a 
sequence in one of these spaces converges to a function / in the same 

space if the sequence is contained in a bounded subset and the /^'s converge 
to / uniformly on compact subsets of R", and that a sequence in 
one of these spaces is a Cauchy sequence if it is contained in a bounded 
subset of the space and it satisfies the usual Cauchy condition with respect 
to the supremum norm on any compact subset of R"^. By standard reasoning 
each such Cauchy sequence converges uniformly on compact subsets of R" 
to a continuous function on R" of polynomial growth, so that each Cauchy 
sequence converges. 

In other words, on each bounded subset of PC(R",R), VC{W,C), we 
are using the same topology as for C(R", R), C(R", C). Notice that for each 
nonnegative real number C and each positive integer j, the set of real or 
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complex- valued continuous functions f{x) on R" such that is bounded 

by C (1 + \x\y on R" is a closed subset of C(R", R), C(R", C), respectively. 
Also, convergence of a sequence in such a set uniformly on compact subsets 
of R" is equivalent to convergence with respect to the norm 

(4.21) sup{|/(x)| (1 + \x\y+^ : X e R"}. 

Sums and products of continuous functions of polynomial growth on R" 
are continuous functions with polynomial growth, and these operations be- 
have well in terms of bounded collections of functions and convergence of 
sequences of functions in the senses described above. One can also think of 
multiplication as defining binary operations 

(4.22) VC{W,R) xnC(R'',R) nC{R'','R), 

(4.23) PC(R",C) x7^C(R'*,C) ^ 7^C(R",C), 

and these operations behave well in terms of bounded sets and convergent 
sequences in these spaces too. Ordinary polynomials on R" are continuous 
functions with polynomial growth, and standard considerations for them fit 
in a nice way with the spaces of general continuous functions of polynomial 
growth, e.g., a collection of polynomials is bounded in the sense discussed 
here if their degrees and coefficients are bounded. 



4.4 More on spaces of sequences 

Let 1 < p, g < oo be conjugate exponents, so that 

1 1 

4.24 - + - = 1. 

p q 

liw = {wj}°l^ is an element of ei{K), ei{C), then 

oo 

(4.25) Xyj{x) = J2^j^j^ = 

defines a bounded linear functional on £^(R), ^^(C), respectively. This uses 
Holder's inequality to say that the sum converges, and also that 

(4.26) \Xw{x)\ < \\w\\q \\x\\p. 
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We can turn this around a bit and say that for each w in -^^(R), -^^(C), 
the hnear functional A^,, leads to a seminorm 



(4.27) |A^(a;)| 

on i^{C), and that the family of these seminorms defines a topology on 

£^(R), £^(C) which gives the structure of a locally convex topological vector 
space. This topology is less restrictive than the one associated to the norm 
1 1 X lip. In the case of p = 1, there is a variant of this where one only uses the 
family of seminorms corresponding to w in co(R), co(C), respectively, and 
this version is nicer in several respects. 

Let r be a positive real number, and consider the subset of ^^(R) or £^(C) 
consisting oi x = such that 

(4.28) ||a;||p < r. 

Of course this is a convex set which is closed with respect to the topology 
associated to the norm \\x\\p. One can also check that this set is closed with 
respect to the topology coming from linear functionals as in the previous 
paragraph, using either cq or when p = 1. 

Let E he a. dense subset of £^(R) or £'^(C), as appropriate, or of Co(R), 
Co(C) when p — 1. Actually, it is enough to choose E so that its span is 
dense for the present purposes. When 1 < g < oo, or if one uses cq instead 
of £°° when p — 1 and g = oo, one can take £^ to be a countable set, which 
is a nice thing to do. 

On the set of x = {xj}'^^ in £*'(R) or i^{C), as appropriate, such that 
1 1 a; lip < r, the topology that one gets from the seminorms |A^(|/)|, w e 
E, is the same as the topology that one gets from using the seminorms 
corresponding to all w in £^ or cq, as appropriate. This is not too difficult 
to verify, and it would not work on the whole space instead of just this 
bounded part of it. This uses the fact that if Wi, W2 are close in i'^ or cq, 
then 

(4.29) A^-^ A^2 — Xyjj^—xu2 

is uniformly small on this bounded subset of i^. 

Let us consider some other spaces of sequences, namely, r£(R), r£(C), 
consisting of sequences which decay rapidly, andp£(R), r£(C), consisting of 
sequences with polynomial growth. To be more precise, r£(R), ri{C) are the 
real and complex vector spaces of real and complex sequences x = {xj}'j^i, 
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respectively, such that for each positive integer k there is a nonnegative real 
number C{k) so that 

(4.30) \xj\<C{k)j-'' 

for all j G Z+. Also, p£(Ti), p£{C) are the real and complex vector spaces of 
real and complex sequences x = {xjj'jL^ for which there is a positive integer 
I and a nonnegative real number C such that 

(4.31) kj|<C/ 
for all j G Z+. 

On r£(R), r£{C), we have for each positive integer k the seminorm defined 

by 

(4.32) sup{/|x,|:jGZ,.}, 

and this family of seminorms defines topologies on r£(R), r£{C), so that they 
become locally convex topological vector spaces. A subset E of r£(R), r£{C) 
is bounded if and only if for each positive integer k there is a nonnegative 
real number C{k) such that \xj\ < C{k) for all x & E and j G Z+. 
As usual, one can check that r£(R), r£{C) are complete, so that they are 
actually Frechet spaces. 

In pi'(R), p^(C), we can make the convention that a subset E is bounded 
if and only if there is a positive integer I and a nonnegative real number C 
such that 

(4.33) \xj\<Cj^ 

for all X — in E and all j G Z_(_. We can make the convention that 

a sequence of elements of p£(R) or p£{C) converges to another element in 
the same space if the sequence is contained in a bounded subset as in the 
previous sentence and one has pointwise convergence. We can also make 
the convention that a sequence of elements of p^(R) or p£{C) is a Cauchy 
sequence when it is contained in a bounded set and one has Cauchy sequences 
pointwise, so that Cauchy sequences always converge in these spaces. 

4.5 Weak topologies and bilinear forms 

Let V he Si topological vector space, and let A be a linear functional on V . 
If A is continuous, then there is an open subset U olV such that G C/ and 



(4.34) 



|A(^)|<1 
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for all V E U. The converse is also true, which is to say that if there is such 
an open subset U of V, then A is continuous, as one can check using the 
linearity of A. 

Now suppose that y is a vector space and that is a nonempty family 
of seminorms on V. In the topology on V generated by the sets 

(4.35) {v eV : N{v) < r}, 

where is a seminorm on V in the family and r is a positive real number, 
are open subsets of V, and in fact form a sub-basis for the topology of V at 
0. In other words, if U is an open subset of V in this topology such that 

e [/, then there are seminorms Ni, Ni in the family T and positive real 
numbers ri, . . . ,ri such that 

(4.36) nti {veV: Ni{v) < n} c u. 

Let A be a linear functional on V again. It follows that A is continuous if 
and only if there are seminorms Ni, . . . ,Ni in the family and positive real 
numbers ri, . . . ,r; such that \X{v)\ < 1 for ell v E V such that Ni{v) < rj, 

1 < i < I. This is equivalent to saying that there are seminorms Ni, . . . ,Ni 
in the family and nonnegative real numbers Ci, . . . , C; such that 

(4.37) \X(v)\ < maix{CiNi(v) : 1 < i < 1} 
for all V eV. 

Assume now that V and W are vector spaces, both real or both complex, 
and that B{v,w) is a bilinear form onVxW. This means that B[v,w) is a 
function from V x W to the real or complex numbers, whichever are being 
used as scalars, such that v h- > B{v,w) is a linear functional on V for each 
w eW and w ^ B{v, w) is a hnear functional on W for each v & V. Let us 
also assume that B{v,w) satisfies the nondegeneracy property that for each 
V eV with V there is a ty e 1^ such that 

(4.38) B{v,w)^0. 

We can associate to B the family J^{B) of seminorms on V given by 
\B{v,w)\, w e W, and this defines a topology on V which makes V into a 
topological vector space. By construction, each linear functional on V of the 
form B{v,w) for some w & W is a. continuous linear functional with respect 
to the topology just defined. Conversely, one can check that every continuous 
linear functional on V with respect to this topology is of this form. 
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5.1 Power series and spaces of sequences 

In this section we use complex numbers as scalars. A power series is a series 
of the form 

oo 

(5.1) E«n^", 

n=0 

where the coefficients a„ arc complex numbers and 2; is a complex variable. 
One can add power series, multiply them by complex numbers, or even mul- 
tiply two power series to get another one. 

A power series as above converges at some Zq in C if the infinite series of 

scalars 

00 

(5.2) ^a„^o" 

n=0 

converges in the usual sense, and the power series converges absolutely at zq 
if this series converges absolutely in the usual sense, which is to say that 

00 

(5.3) E K\ l^ol" 

n=0 

converges. A well-known fact states that a power series which converges for 
some zq & C converges absolutely for all ^ e C such that \z\ < \zq\. It 
follows that there is a radius i?, < i? < 00, called the radius of convergence 
of the power series, such that the power series converges absolutely when 
\z\ < R and does not converge when \z\ > R, with the behavior for \z\ — R 
depending on the situation. 
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Another basic fact is that on {2; G C : 1^1 < R}, the partial sums of the 
power series converges uniformly on compact subsets, and hence the power 
series defines a continuous function f{z) on this region. Moreover, f{z) is 
holomorphic, which means that 

(5.4) = , taZ(i±4^ 

exists for all z G C with \z\ < R. In fact, the formal power series for f'{z), 
given by 

00 

(5.5) E^^""'. 

n=l 

has the same radius of convergence as the one for f{z), and is equal to f'{z) 
for 2 G C, \z\ < R. 

If < t < 00, let us define At to be the complex vector space of power 
series I]^o '^n ^" which converge for 1^1 < t, which is the same as saying that 
the radius of convergence is at least t. For each positive real number r < t 
and power series J2'^=o o-n in Ar, consider the expression 

(5.6) sup{|a„|r" : n > 0}. 

This is finite since Yl^=QO'nZ^ is assumed to converge when \z\ = r, and 
conversely converges for z G C with < t when these quantities 

are finite for each r G (0, t). 

The expression (j5.6|) defines a seminorm on At for each r G (0, t), and this 
family of seminorms determines a topology on At which makes it into a locally 
convex topological vector space. It suffices to consider r's in an increasing 
sequence that tends to t, so that in fact one only needs a countable family 
of seminorms here. It is not difficult to verify that At is complete, so that it 
is actually a Frechet space. 

Every power series in At defines a holomorphic function on {2; G C : 
\z\ < t}, and basic results in complex analysis imply that every holomorphic 
function on this region can be represented by a power series. If f{z) is a 
holomorphic function defined for z G C, \z\ < t, and if s is a positive real 
number with s < t, then one can consider the quantity 

(5.7) snp{\f{z)\:zeC,\z\<s}. 

This is another family of seminorms on holomorphic functions on the region 
G C : |z| < t}, and one can show that it is equivalent to the earlier family 
of seminorms, in the sense that they define the same topology on At- 
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The product of two holomorphic functions on {2; G C : \z\ < t} is also a 
holomorphic function on this region. At the level of power series, we have 

/ oo \ / oo \ 00 

(5.8) E«.^' [J2bkz')=J2cmZ^ 

S=0 ^ ^fc=0 ^ n=0 

with 

m 

(5.9) Crri = ^a/fem-i, 

1=0 

and Z]m=oCm^™ converges when |z| < t if YfjLoO'j , J2kLo^k converge 
when 1^1 < t. Multiplication is continuous on At, so that At defines a topo- 
logical algebra. 



5.2 Absolutely convergent Fourier series 

In this section we again restrict ourselves to complex numbers as scalars. Let 
us write AC for the complex vector space of absolutely convergent Fourier 
series, by which we mean series of the form 

00 

(5.10) ^nZ"", 

n=—OD 

where we think of Z clS Sb variable taking values in the unit circle 

(5.11) T = G C : 1^1 = 1}, 
and where the series 

(5.12) Yl K\ 

n=— 00 

converges. Thus (j5.1(J|) converges absolutely for each z E T, and the partial 
sums converge uniformly to a continuous function on T. 
On the unit circle the series ()5.10|) is equal to 

00 00 

(5.13) 5]a_„^" + Ea„z", 

n=l n=0 

where z denotes the complex conjugate of z. Under the assumption that 
I]^_oo kri| converges, the series in ()5.13|1 converge uniformly and absolutely 
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on the closed unit disk, which is the set of 2; G C such that \z\ < 1. The sum 
defines a continuous function f{z) on the closed unit disk which is smooth 
and harmonic in the interior, i.e., Af{z) = when \z\ < 1, where A is the 
Laplace operator d'^/dx'^ + d'^/dy'^, z = x + yi. 

On AC we have a natural norm, namely, Y^^=_^ |a„|. This is basically 
the same as ^^(C) as a normed vector space. In particular, AC is complete 
with respect to this norm, and thus becomes a Banach space. 

We can also multiply these series, i.e.. 



(5.14) a,zA(j: 6..M= E 



where 



(5.15) Cm= J2 



m—l ■ 



l=—oo 



Assuming that 

00 00 
(5-16) l^il' H l^fcl 

j=—co k=—oo 

converge, one can check that the series defining Cm converges, and that 

(5.17) E k™l<(E I«.|)(E I^^'I)- 



m=— 00 



In other words, AC is a normed algebra with respect to multiplication of 
series. 

Multiplication of series in this way corresponds exactly to multiplying 
the functions on the unit circle defined by the series. This does not work 
for the extensions to the closed unit disk described above, although that 
is compatible with addition and scalar multiplication. Alternatively, under 
suitable conditions on the coefficients a„, the series fl5.1()j) can converge on 
an annular region around the unit circle, defining a holomorphic function on 
that region, and products of these "Laurent" series correspond to products 
of the holomorphic functions that they define. 



5.3 Spaces of smooth functions 

For each positive integer k, let C'^(R"',R), C''(R",C) denote the real and 
complex vector spaces of real and complex- valued functions f{x) on R", 
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respectively, which are continuously differentiable of order k, i.e., which are 
continuous and for which the partial derivatives of f{x) up to and including 
order k exist at each point in R" and are continuous functions. We also 
allow k — oo here, for the spaces of continuous functions for which partial 
derivatives of all orders exist and are continuous. For 1 < A; < oo we write 
Cqq(R",R), Cqq(R'^,C) for the vector spaces of continuous functions on R" 
with compact support which are continuously differentiable of order k. 

By a multi-index we mean an n-tuple a = (ai, . . . , of nonnegative 
integers, and we write |q;| for |q;i| + • • • + |q;„|. For each such multi- index a, 
we have the corresponding partial derivative of order \a\ defined by 

(5.18) d'' ' 



When |q;| = this is interpreted as being the identity operator, so that 
d-f{x)^f{x). 

Suppose that 1 < A; < oo, / is a positive integer, and « is a multi-index 
such that \a\ < k. li f{x) is a real or complex- valued function on R*^ which 
is continuously differentiable of order k, consider the quantity 



(5.19) sup{|9"/(x)| : X e R", \x\ < I}. 

This defines a seminorm on C^'(R", R), C'''(R", C). 

With this family of seminorms, C^(R",R), C''(R", C) become topologi- 
cal vector spaces. As usual, it is not too difficult to show that these spaces 
are complete, so that they arc in fact Frcchct spaces. Also, the product of 
two functions which are continuously difi'crcntiablc of order k is also continu- 
ously differentiable of order k, and these spaces are topological algebras with 
respect to ordinary multiplication. 

The spaces Coo(R'"', R), Coo(R'"', C) have natural topologies in which they 
are inductive limit spaces. Two main points are that bounded subsets of these 
spaces consist of functions with support contained in a fixed compact subset 
of R", and that when one restricts to a subspacc of functions with support 
contained in a fixed compact subset of R", the topology is determined by 
seminorms as above, with I chosen large enough so that the supports are 
contained in the closed ball in R" with center and radius /. Continuous 
linear functionals on C^{Il"', R), C^(R'*, R) are often called distributions or 
generalized functions. 
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Now let us define the Schwartz classes (S(R", R), <S(R"', C) of rapidly de- 
creasing smooth functions on R". Namely, a real or complex-valued function 
f{x) on R*^ is in the Schwartz class if /(x) is infinitely-differentiable and if 
for each multi-index a the function d°'f{x) is rapidly decreasing on R". This 
is equivalent to saying that for each pair of multi-indices a, /3, the function 
d°'f{x) is bounded on R", where 

(5.20) 

and this is interpreted as being equal to 1 when =0. 

Thus we have a natural family of seminorms on the Schwartz classes, 
given by 

(5.21) snp{\x^d''f{x)\:xeK"}, 

where a, (3 run through all multi-indices. This family of seminorms define 
topologies on the Schwartz classes, so that they become locally convex topo- 
logical vector spaces. One can check that these spaces are complete, and 
hence are Prechet spaces. 

It is easy to see that the product of two functions in <S(R", R), «S(R", C) 
lies in the same space, and in fact that the Schwartz classes are topological 
algebras. This is not really the whole picture, since for instance the product 
of a function in the Schwartz class and a polynomial lies in the Schwartz 
class. Also, derivatives of functions in the Schwartz class lie in the Schwartz 
class. 

Continuous linear functionals on the Schwartz classes are called tempered 
distributions. In the case of complex-valued functions, a key point about the 
Schwartz class is that the Fourier transform takes »S(R", C) to itself. This 
leads to a nice theory of Fourier transforms of tempered distributions. 

If 0(x), f{x) are functions on R", then the convolution is denoted (f)*f{x) 
and is basically defined by 

(5.22) (i>*f{x)= I <P{y)f{x-y)dy. 

Depending on the circumstances, one sliould perhaps be careful about the 
integral. For instance, this makes sense if both 0, / are continuous and one 
of them has compact support, or if one of them lies in the class of rapidly 
decreasing continuous functions on R" and the other lies in the class of 
continuous functions with polynomial growth. 
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More precisely, if is a continuous function on R" with compact support, 
then 
(5.23) 

defines a continuous hnear mapping from the vector space of continuous 
functions on R*^ to itself. One can take 0, / to both be real-valued or 
complex-valued here. If both and / have compact support, then so does 
(f)*f. 

Similarly, if 0, / are rapidly decreasing continuous functions on R", then 
6* f is also a rapidly decreasing continuous function on R". If is a rapidly- 
decreasing continuous function on R" and / is a bounded continuous function 
on R", then * / is a bounded continuous function on R". If is a rapidly- 
decreasing continuous function on R" and / is a continuous function on R'* 
with polynomial growth, then * / is a continuous function on R" with 
polynomial growth. 

The operation of convolution is a nice commutative and associative op- 
eration, a kind of product. For instance, if 0i, 02, <p3 are rapidly-decreasing 
continuous functions on R", then 

(5.24) 01 * 02 = 02 * 01 

and 

(5.25) 01 * (02 * 03) = (01 * 02) * 03- 

The spaces of rapidly-decreasing real or complex-valued continuous functions 
on R" are topological algebras with respect to convolution, as well as with 
respect to ordinary multiplication. 

Convolutions also behave well in terms of differentiation, in the sense that 

(5.26) a"+^(0 * /) = (9"0) * (d^f) 

under suitable conditions on 0, /. For instance, this holds when is continuously- 
diffcrentiable of order /, / is continuously-differcntiablc of order m, \a\ < I, 
\P\ < m, and at least one of 0, / has compact support. In particular, * / 
is continuously differentiable of order Z -|- m in this case. 

5.4 Banach algebras 

Let ^ be a real or complex normed algebra, with norm ||a|| , which is complete 
as a normed vector space. In this case we say that ^ is a Banach algebra. We 
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shall make the standing assumption that A contains a nonzero multiplicative 
identity element, denoted 1, with norm equal to the real number 1. 

A basic class of Banach algebras consists of the algebras of bounded 
linear operators on a Banach space. We shall discuss this case further in 
the next section. A basic class of commutative Banach algebras consists 
of the algebras of real or complex-valued continuous functions on compact 
Hausdorff topological spaces, using the supremum norm. 

An element a of ^ is said to be invertible if there is a 6 e ^ such that 

(5.27) ba^ab^l. 

Such an element b is unique if it exists, and is denoted a~^. If ai, 02 are 
invertible elements of A, then the product ai 02 is invertible, and 

(5.28) (fli 02)"^ = a]"^- 

A basic result about Banach algebras is that if a G ^ and ||a|| < 1, then 
1 — a is an invertible element of A. Indeed, we can use the usual formula 

00 

(5.29) (l-a)-^ = ^a^ 

j=0 

where a° is taken to be 1. Because ^ is a Banach algebra, 

(5.30) lla^'ll < \\a\\\ 

and this implies that the series above converges when ||a|| < 1, and that 

1 



(5.31) ll(l-a)-^ll< 



1 - Hal 



More generally, if x is an invertible element of A, and if a is an element 
of A such that 

(5.32) ||a|| < 

then x — a is an invertible element of A, and 

(5.33) \\{x - ay^W < - ""^ " 



X ^1 



Indeed, x — a = x{l — x~^ a), which is then the product of two invertible ele- 
ments of A. Thus the group of invertible elements of A, under multiplication, 
is an open subset of A. 
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Let us restrict our attention for the rest of the section to the situation 
where complex numbers are used as scalars. If A is a complex number, 
then we can also view A as an element of A, namely, as a multiple of the 
multiplicative identity element. As is well known, even if one starts with real 
scalars, often complex numbers are in the vicinity and play an important role 
anyway. 

For each element a of A, the resolvent set associated to a is the set of 
complex numbers A such that A — a is invertible in A. The spectrum of a is 
the complement of this set in C, which is to say the set of complex numbers 
A such that A — a is not invertible. By the earlier remarks, the resolvent set 
is always an open subset of C, and the spectrum is always a compact subset 
of C. 

A famous result states that the spectrum of a, a e A, always contains at 
least one element. The basic idea of the proof is that if the spectrum of a 
were empty, then (A — a)~^ would define a holomorphic function on all of C, 
with values in A. Because we can analyze (A — a)~^ easily when |A| is large, 
we see that (A — a)~^ should in fact be bounded, and behave like 1/A when 
A is large, while a bounded holomorphic function should be constant. 

In any case, (A — a)~^ defines a holomorphic function on the resolvent of 
a with values in A. These expressions can be used to define f{a) whenever 
f(z) is a holomorphic complex- valued function defined on a neighborhood of 
the spectrum of a. Namely, one can use the Cauchy integral formula applied 
to a family of curves in the resolvent of a which also lie in the domain of / 
and surround the spectrum of a. 

If n is a positive integer and A is a complex number such that 

(5.34) |A|">||a"||, 

then A lies in the resolvent set of a. When n = 1 this follows from the 
remarks near the beginning of the section. In general, one first applies those 
remarks to obtain that A" — a" is invertible, and then it follows that A — a is 
invertible, since 

(5.35) A"-a" = (A-a)(A"-^ + A"-2a + --- + a"-^). 

The spectral radius of a, a G A, is defined to be the maximum of |A|, 
where A runs through the spectrum of a. Thus the spectral radius of a is less 
than or equal to the norm of a, and in fact the spectral radius of a is less 
than or equal to 

(5.36) lla'^ll^/" 
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for every positive integer n, by the remarks of the previous paragraph. A 
famous result states that the spectral radius of a is equal to 

lim lla'^lP/". 

n— >oo 

To prove this one can again use complex analysis. Let p denote the 
spectral radius of a, and let r be any real number such that r > p. Consider 
the holomorphic function (A — a)~^ again, on the region {z & C : \z\ > p}, 
and which we know also behaves well at the point at infinity. 

For reasons of compactness and continuity, (A — a)~^ is bounded on the 
set of A G C such that |A| = r. Using complex analysis, we can express a"- 
in terms of integrals of (A — a)~^ on the circle where |A| = r. This leads to 
bounds for a" in terms of r", as desired. 

A fundamental case occurs when M is a compact Hausdorff topological 
space, and A is the Banach algebra of continuous complex- valued functions 
on M, using the supremum norm 

(5.38) \\f\\sup = sup{\fix)\:xeM}. 

It is easy to see that a complex number A lies in the spectrum of a complex- 
valued continuous function / on M if and only if A lies in the image of /. As 
a result, the spectral radius of / is equal to the norm of / in this situation. 

Another very interesting case occurs when we consider the Banach algebra 
of complex- valued continuous functions f{z) on the closed unit disk {z & C : 
\z\ < 1} which are holomorphic inside the unit disk. In other words, we 
assume that there is a power series 

oo 

(5.39) E"-'^" 

n=0 

which converges for every z & C with \z\ < 1, and that the function f{z) 
on the open unit disk that it defines extends to a continuous function on the 
closed unit disk. It follows from standard results that sums and products of 
such functions arc again of the same type. 

For the norm we use the supremum norm, and in fact by the maximum 
principle for holomorphic functions the supremum of \f{z) \ for such a function 
/ over the 2; G C with \z\ < 1 is the same as the supremum over the z E C 
such that \z\ = 1. Also, the coefficients a„ of the power series expansion of / 
on the open unit disk can be given through well-known formulae as integrals 



(5.37) 
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of / on the unit circle. In short, the functions on the closed unit disk in 
this algebra are determined by their restrictions to the unit circle, and we 
can think of this as a closed subalgebra of the algebra of complex-valued 
continuous functions on the unit circle. 

In this case again the spectrum of a function f{z) in the algebra is given by 
the image of f{z) as a function on the closed unit disk. This is rather striking 
when we think of the algebra as a closed subalgebra of the complex-valued 
continuous functions on the unit circle. The spectral radius of a function in 
the algebra is equal to the norm of the function. 

As a third example, let us consider the algebra AC of series of the form 

oo 

(5.40) Yl ^nZ"", 

n=— oo 

where we think of the variable z as taking values in the unit circle 

(5.41) {zeC:\z\ = 1}, 

and where the coefficients a„ are assumed to be absolutely summable, so that 

oo 

(5.42) 

n=— oo 

converges. Basically our series is then the Fourier series of a continuous 
function on the unit circle, and the coefficients a„ can be given in terms of 
integrals of the function on the circle. We define the norm in this case to be 
the sum of the moduli of the coefficients a„, and this is automatically greater 
than or equal to the supremum norm of the corresponding function on the 
unit circle. 

In general this norm is strictly larger than the supremum norm of the 
corresponding function f{z) on the unit circle. Also, although one can define 
the Fourier coefficients a„ of any continuous function f{z) on the unit circle, 
in general they may not converge absolutely, as for elements of AC. However, 
under modest additional regularity assumptions on /(-z), one can show that 
the Fourier coefficients do converge absolutely, and that the Fourier series 
converges to f{z) everywhere on the unit circle. 

In this example it is a famous result that the spectrum of an element of 
AC is equal to the image of the corresponding continuous function on the 
unit circle, and hence that the spectral radius is equal to the supremum norm 
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of the function. In other words, when a continuous function on the unit circle 
which has an absolutely convergent Fourier series is invertible as a simply a 
continuous function, then the inverse also has absolutely convergent Fourier 
series. In this connection, let us note more broadly that for many regularity 
conditions for a function, if one has a continuous function which satisfies that 
regularity condition and which is invertible as a continuous function, then 
the inverse also satisfies the same regularity condition. 

5.5 Bounded linear operators on Banach spaces 

Let y be a real or complex Banach space, with norm \\v\\. If T is a bounded 
linear operator on V, then the operator norm of T is denoted ||T||op and 
defined by 

(5.43) \\T\\op = sup{||r(^;)|| :veV, \\v\\ < 1}. 

Of course the identity operator 7 on y is a bounded linear operator with 
norm equal to 1. 

Using composition of linear operators as multiplication, the bounded lin- 
ear operators on V becomes a Banach algebra. It is easy to see that the 
operator norm automatically satisfies the required conditions, and one has 
completeness for the space of bounded linear operators on V because of com- 
pleteness for V itself. A bounded hnear operator on V is invertible as an 
element of this algebra if and only if it is invertible in the usual sense, as a 
linear operator on V, where the inverse is also bounded. 

If T is a bounded linear operator on V, then T is invertible if and only 
if (i) the kernel of T, which is the hnear subspace of V consisting of vectors 
V such that T{v) — 0, is the trivial subspace {0}, (ii) there is a positive real 
number c such that 

(5.44) ||r(v)|| > cll-ull 

for all V & V, and (iii) the image of T is dense in V. Condition (i) is of course 
implied by (ii), but it is simpler and convenient to state separately. In some 
cases (iii) can be derived from (i), and we shall say more about this soon. 

More precisely, under condition (ii) above, the image of T is a closed 
hnear subspace of V. Indeed, let {wjj^i be any sequence in the image of T 
which converges to some w & V. We can write wj as T{vj), where {vj}j^i 
is a Cauchy sequence in V, because of condition (ii), and therefore {vj}j^i 
converges to some v G V, and w = T{v), as desired. 
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Because the image of T is a closed subspace of V and is also dense, by 
condition (iii), we have that the image of T maps V onto V. Of course 
condition (i) states that T is one-to-one, so that T is invertible as a linear 
mapping of V onto V. Condition (ii) implies that the inverse of T is bounded, 
with norm less than or equal to c~^. 

There is a general result in the theory of Banach spaces, called the open 
mapping theorem, which implies that a bounded linear mapping TofV onto 
V with trivial kernel has bounded inverse. In the proof, one first uses the 
Baire category theorem to show that the image of the closed unit ball in V 
under T contains a neighborhood of the origin, and then one shows that in 
fact the image of the open unit ball in V under T contains a neighborhood 
of the origin. The first step docs not give quantitative information, and for 
that matter the hypotheses are not very quantitative anyway. 

One should not necessarily take this result too seriously, although it is 
interesting that the continuity of the inverse is connected to surjectivity in 
principle in this manner. In practice, one often derives an estimate anyway. 
It is not so easy to show that a mapping is surjective, and a common way 
to do this is to establish the appropriate bound and show that the image is 
dense. 

Another general result, called the closed graph theorem, says that a linear 
mapping T from the Banach space V to itself is continuous if its graph, as a 
linear subspace of V x V, is closed. To be more explicit, the graph of T is 
closed if for every sequence {wj}"^]^ in V which converges to and has the 
property that {T(t'j)}°2,^ converges in V, we have that limj^^T{vj) = 0. 
One can derive the closed graph theorem from the open mapping theorem, 
because the mapping {v, T{v)) i— > v defines a continuous linear mapping from 
the graph of T onto V, and the assumption that the graph of T is closed 
implies that it is a Banach space, so that the inverse mapping v i— >■ {v,T{v)) 
from V to the graph of T is then continuous too. 

Again, one should not necessarily take this result too seriously, although 
it is interesting again that in principle the continuity of T is implied by 
apparently quite mild conditions. Of course having T be defined everywhere 
on the Banach space, and in some reasonable manner, is already a pretty 
strong condition. As before, in practice this is often because one derives an 
estimate anyway, on a dense subspace of V, and then extends the operator 
to all of V by continuity. 

Let us specialize for the moment to the case where V is a Hilbert space. 
This means that there is an inner product {v, w) on V which determines 
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the norm on V, and that V is complete with respect to this norm. More 
precisely, the inner product (v, w) is a function from V x V to the real or 
complex numbers, as appropriate, such that 

(5.45) V I— > {v, w) 

is a linear functional on V for each v ^ V, the symmetry condition 

(5.46) {w, v) — (v, w) 
in the real case and 

(5.47) {w, v) = {v, w) 
in the complex case holds for all w e and 

(5.48) {v,v) 

is a nonnegative real number for all v E V which is equal to if and only if 
^; = 0. 

When one has such an inner product {v, w), one can define the associated 
norm on V by 

(5.49) \\v\\ = {v,vy^^. 

As is well-known, one has the Cauchy-Schwarz inequality 

(5.50) < 

for aAl v,w G V. This inequality can be used to verify the triangle inequality 

for ||f II, so that \\v\\ is indeed a norm. 

Two elements Vi, V2 of V are said to be orthogonal if 

(5.51) {v^,v2)^0, 

in which case we write vi -L V2- If vi -L V2, then 

(5.52) |ki + 'y2||^ = Il'y2||^. 

For any two elements Vi, V2 of V, whether or not they are orthogonal, we 
have the parallelogram identity 

(5.53) \\vi + V2\\'^ + lit;! - vslP = 2 \\vi\\^ + 2 \\v2\\'^. 
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Let W he d. linear subspace of V. The orthogonal complement of W in 

V is denoted W-^ and defined to be the set of z & V such that z w for all 
w E W. It is easy to see that W-^ is automatically a closed subspace of W, 
and that 

(5.54) wnw^^ {0}. 

Suppose that is a linear subspace of V, that v is an element of V, and 
that w is an element of W such that v — w E W-^. Such an element w of 
W is uniquely determined by v, since if G also satisfies v — w' E W-^, 
then w — G and w — w' = {w — v) + {v — w') G W-^. Also, if ti is any 
element of W , then 

(5.55) ||v — = {v — u,v — u) 

— {v — w,v — w) + {w — u,w — u) — \\v — w\\^ + \\w — u\\^, 

and hence w is the unique element of W whose distance to v is as small as 
possible. 

Conversely, suppose that W is a closed linear subspace of V and that 

V is an element of V, and let us show that there is a, w E W such that 
{v — w,u) = for all G W. We do this by looking for an element of W 
whose distance to v is as small as possible. If 

(5.56) disiiy, W) = ini{\\v -z\\:zeW} 

is equal to 0, then v G W, because W is assumed to be closed, and we can 
simply take w — v. 

For each positive integer j, choose Wj eW so that 

(5.57) 11^; - Wj\\ < dist(v, W) + -.. 

If j and I are positive integers, then the parallelogram identity applied to 

V — Wj, V — wi yields 

(5.58) \\2v — Wj — wiW'^ + \\wj — wiW^ = 2\\v — + 2 ||w — wiW^. 
Because 

(5.59) \\2v-Wj-wi\\=2 
we get that 

(5.60) \\wj - wif < 4dist{v, W)i^- + yj + 4 + ^• 



V — 



w^ 



> 2dist(7;,PF), 
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This shows that {wj}'jLi is a Cauchy sequence in V. The assumption 
that V is complete imphes that this sequence converges to a point w G W, 
since W is supposed to be a closed subspace of V. Thus 

(5.61) \\v-w\\^dist{v,W), 

and it is not difficult to derive from this that v — w E W-^. 

Let us write Pw{v) for the unique element w oi W such that v — w & 
W-^. It is easy to see that Pw is a linear mapping from V to W such that 
Pw{w) — w when w e W, Pwiu) — when u e H^"*", and 

(5.62) \\v\\^ = ||^T^(^)||' + \\v - PwivW- 

Thus Pw is a bounded linear operator on V with norm equal to 1, except in 
the trivial case where W — {0}, when Pw is the zero operator. 

This operator Pw is called the orthogonal projection of V onto W. Notice 
that for all Vi,V2 & V we have that 

(5.63) {Pw{vi),V2) = {Pw{v^),Pw{v2)) = {vi,Pwiv2)). 

Also, if is a closed linear subspace of V which is not equal to it follows 
that there are nonzero elements of V in W^. 

In general a bounded linear operator A on V is said to be self-adjoint if 

(5.64) {A{v),w) ^ {v,A{w)) 

for all V, w e y. Observe that the sum of two self- adjoint bounded hnear 

operators on a Hilbcrt space is also sclf-adjoint, and a real number times a 
self-adjoint operator is again self-adjoint. The restriction to real multiples is 
important when y is a complex Hilbert space. 

Suppose that A is a self-adjoint bounded linear operator on V. If v is any 
vector in V, then A{v) — if and only if 

(5.65) {A{v),w) = Q 
for every w eV, and this holds if and only if 

(5.66) {v,A{w)) = 0, 



which is to say that v is orthogonal to the image of A. Thus A has trivial 
kernel if and only if the image of A is dense in V. 
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Thus, a self-adjoint bounded linear operator A on y is invertible if and 
only if there is a positive real number c such that 

(5.67) ||A(t;)|| > cll-yll 

for all V & V. In particular a self-adjoint bounded linear operator A is 
invertible if it satisfies the positivity condition that there is a positive real 
number a such that 

(5.68) {A{v),v) >a\\vf 

for all V eV. Let us note that if S is a self-adjoint bounded hnear operator 
on V which is invertible, then A — B^ satisfies the kind of positivity condition 
just mentioned. 

Now let us return to the setting of a general Banach space V. We would 
like to consider operators of the form T + A, where T is a bounded linear 
operator on V which is invertible and A is a bounded linear operator which 
is in the closure of the space of finite-rank bounded linear operators on V, 
with respect to the operator norm. Recall that a linear mapping between 
vector spaces has finite rank if its image is finite-dimensional. 

Here is a basic situation. Let V be the space of real or complex- valued 
continuous functions on the unit interval, and suppose that a{x, y) is a real 
or complex- valued continuous function on the unit square [0,1] x [0,1], as 
appropriate. One can show that the integral operator on V defined by 

(5.69) A{f){x)= [\{x,y)f{y)dy 

Jo 

is a bounded linear operator which can be approximated in the operator norm 
by bounded finite-rank linear operators on V, using the fact that a{x,y) is 
uniformly continuous on [0, 1] x [0, 1]. 

If T is a bounded linear operator on V which is invertible and A can be 
approximated in the operator norm by finite rank operators, then we can 
write T + A as Ti + Ai, where Ti is also a bounded linear operator on V 
which is invertible, and Ai is a bounded linear operator on V with finite 
rank. That is, one can subtract a small part from A and add it to T to 
rewrite T -|- yl in this way. A basic fact about operators of this form is that 
they are invertible exactly when their kernels are trivial. 

Assuming that V is a complex Banach space, the spectrum of a bounded 
linear operator R is defined to be the set of complex numbers A such that 
XI — Ris not invertible. If is a complex Hilbert space and R is self-adjoint. 
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then one can check that the spectrum of R consists of real numbers. On a 
complex Banach space in general, if R can be approximated in the operator 
norm by finite rank operators, then a nonzero complex number A lies in the 
spectrum of R if and only if A is an eigenvalue of R, which is to say that 
there is a nonzero vector v &V such R{v) — Xv. 
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